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(57) ABSTRACT 

An agent based system utilizes a Personal Digital Assistant 
(PDA)-based, Global Positioning System (GPS)-enabled 
information gathering agent to create a customized offer 
information summary based on the location of a user and one 
or more items of interest. One or more items of interest are 
obtained from a user. The physical location of the user is 
determined. A query based on the items of interest and the 
physical location of the user is then created. A network of 
information is queried utilizing this query. A customized 
offer is received from a retailer-based agent in response to 
the query. The customized offer information associated with 
the items of interest and their locations relative to the 
physical location of the user is displayed. 
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SYSTEM, METHOD AND ARTICLE OF 
MANUFACTURE FOR LOCATION-BASED 
FILTERING FOR SHOPPING AGENT IN THE 
PHYSICAL WORLD 

5 

FIELD OF THE INVENTION 

The present invention relates generally to information 
gathering agents and more specifically to a shopping agent 
that incorporates the physical location of the user into the 
information gathering process. 10 

BACKGROUND OF THE INVENTION 

Agent based technology has become increasingly impor- 
tant for use with applications designed to interact with a user 
for performing various computer based tasks in foreground 
and background modes. Agent software comprises computer 
programs that are set on behalf of users to perform routine, 
tedious and time-consuming tasks. To be useful to an 
individual user, an agent must be personalized to the indi- 
vidual user's goals, habits and preferences. Thus, there 20 
exists a substantial requirement for the agent to efficiently 
and effectively acquire user-specific knowledge from the 
user and utilize it to perform tasks on behalf of the user. 

The concept of agency, or the user of agents, is well 25 
established. An agent is a person authorized by another 
person, typically referred to as a principal, to act on behalf 
of the principal. In this manner the principal empowers the 
agent to perform any of the tasks that the principal is 
unwilling or unable to perform. For example, an insurance 3Q 
agent may handle all of the insurance requirements for a 
principal, or a talent agent may act on behalf of a performer 
to arrange concert dates. 

With the advent of the computer, a new domain for 
employing agents has arrived. Significant advances in the 35 
realm of expert systems enable computer programs to act on 
behalf of computer users to perform routine, tedious and 
other time-consuming tasks. These computer programs are 
referred to as "software agents." 

Moreover, there has been a recent proliferation of com- 40 
puter and communication networks. These networks permit 
a user to access vast amounts of information and services 
without, essentially, any geographical boundaries. Thus, a 
software agent has a rich environment to perform a large 
number of tasks on behalf of a user. For example, it is now 45 
possible for an agent to make an airline reservation, pur- 
chase the ticket, and have the ticket delivered directly to a 
user. Similarly, an agent could scan the Internet and obtain 
information ranging from the latest sports or news to a 
particular graduate thesis in applied physics. Current solu- 50 
tions fail to apply agent technology to existing calendar 
technology to provide targeted acquisition of background 
information for a user's upcoming events. 

A central issue for developing agents of all types is 
identifying easily computed features that are either very 55 
suggestive of the user's preferences and goals or can some- 
how be used to constrain the task of the agent. Keyword - 
based approaches are commonly used. For example, users 
may be asked to specify keywords to explicitly identify their 
goals, or keywords and key phrases may be extracted from 60 
user data. Collaborative filtering, another technique, 
involves extending user specified preferences by incorpo- 
rating those of other users whose preferences overlap. The 
demographic generalization method involves classifying a 
user using minimal user input into demographic categories 65 
with well-understood preferences. These techniques are all 
intended to infer as much as possible about a user's goals 
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and preferences based on observable features, while mini- 
mizing the need for user input. These web agents have not 
used physical location as a predictive feature because the 
locations from which users access the web have largely 
remained constant — typically their home or office. 
Moreover, location has not been a particularly easy feature 
to compute and unambiguously communicate to an agent. 

Location has, of course, played a significant role in other 
areas research. Navigation, most obviously, has relied on the 
ability to detect and monitor location. Recent work on 
supporting user mobility in which personalized computing 
environments follow users to remote locations also rely on 
knowledge of a user's location. In these cases, however, 
location is the problem. That is, a vehicle must be guided 
from one point to another, or a computing environment must 
be replicated at a remote location. The ParcTab based 
"location browser", which displays file directories and runs 
programs associated with particular rooms in an office, is 
somewhat similar in its use of location-awareness as a 
means of capturing the user's context. 

However, the explosive growth in the use of laptops and 
Personal Digital Assistants (PDAs) signals an important 
change. As we begin to find ourselves bringing our PDAs 
and laptops everywhere we go, the particular locations we 
use them will increasingly reflect an important part of our 
current context. Furthermore, a user's precise location can 
now be passively and unambiguously obtained by software 
through the use of Global Positioning System (GPS) receiv- 
ers. Such receivers are becoming increasingly affordable and 
compact. Some are now available as PCMCIA cards. In a 
system in accordance with a preferred embodiment, the 
user's location is used in a very different way. Rather than 
defining the problem, the user's location is a crucial piece of 
data that can be used to inform and constrain the information 
gathering task. There is now a business and consumer need 
to enhance the effectiveness of shoppers through the utili- 
zation of location information. 

SUMMARY OF THE INVENTION 

According to a broad aspect of a preferred embodiment of 
the invention, an agent based system an information gath- 
ering agent that exploits the physical location of the user. An 
agent running on a Personal Digital Assistant (PDA) 
equipped with a Global Positions System (GPS) receiver, 
supports location targeted shopping in an outdoor mall. The 
agent assists shoppers by providing information about mer- 
chandise in which the shopper has expressed an interest. As 
a shopper strolls through a mall, the system alerts the 
shopper to merchandise of previously specified categories in 
the surrounding stores, as well as any cheaper alternatives in 
the local area. A system in accordance with a preferred 
embodiment utilizes the user's precise physical location to 
filter the information it presents. 

DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and advantages 
are better understood from the following detailed description 
of a preferred embodiment of the invention with reference to 
the drawings, in which: 

FIG. 1 is a block diagram of a representative hardware 
environment in accordance with a preferred embodiment; 

FIG. 2 is a flowchart of the system in accordance with a 
preferred embodiment; 

FIG. 3 is a flowchart of a parsing unit of the system in 
accordance with a preferred embodiment; 
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FIG. 4 is a flowchart for pattern matching in accordance 
with a preferred embodiment; 

FIG. 5 is a flowchart for a search unit in accordance with 
a preferred embodiment; 

FIG. 6 is a flowchart for overall system processing in s 
accordance with a preferred embodiment; 

FIG. 7 is a flowchart of topic processing in accordance 
with a preferred embodiment; 

FIG. 8 is a flowchart of meeting record processing in 10 
accordance with a preferred embodiment; 

FIG. 9 is a block diagram of process flow of a pocket 
bargain finder in accordance with a preferred embodiment; 

FIGS. 10A and 10B are a block diagram and flowchart 
depicting the logic associated with creating a customized 15 
content web page in accordance with a preferred embodi- 
ment; 

FIG. 11 is a flowchart depicting the detailed logic asso- 
ciated with retrieving user-centric content in accordance 
with a preferred embodiment; 

FIG. 12 is a data model of a user profile in accordance 
with a preferred embodiment; 

FIG. 13 is a persona data model in accordance with a 
preferred embodiment; 25 

FIG. 14 is an intention data model in accordance with a 
preferred embodiment; 

FIG. 15 is a flowchart of the processing for generating an 
agent's current statistics in accordance with a preferred 
embodiment; 

FIG. 16 is a flowchart of the logic that determines the 
personalized product rating for a user in accordance with a 
preferred embodiment; 

FIG. 17 is a flowchart of the logic for accessing the 35 
centrally stored profile in accordance with a preferred 
embodiment; 

FIG. 18 is a flowchart of the interaction logic between a 
user and the integrator for a particular supplier in accordance 
with a preferred embodiment; 40 

FIG. 19 is a flowchart of the agent processing for gener- 
ating a verbal summary in accordance with a preferred 
embodiment; 

FIG. 20 illustrates a display login in accordance with a 
preferred embodiment; 

FIG. 21 illustrates a managing daily logistics display in 
accordance with a preferred embodiment; 

FIG. 22 illustrates a user main display in accordance with 
a preferred embodiment; 5Q 

FIG. 23 illustrates an agent interaction display in accor- 
dance with a preferred embodiment; 

FIG. 24 is a block diagram of an active knowledge 
management system in accordance with a preferred embodi- 
ment; 55 

FIG. 25 is a block diagram of a back end server in 
accordance with a preferred embodiment; and 

FIG. 26 is a block diagram of a magic wall in accordance 
with a preferred embodiment; and 

FIG. 27 illustrates a display of the browser mode in 
accordance with a preferred embodiment. 

DETAILED DESCRIPTION 

A preferred embodiment of a system in accordance with 65 
the present invention is preferably practiced in the context of 
a personal computer such as an IBM compatible personal 
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computer, Apple Macintosh computer or UNIX based work- 
station. A representative hardware environment is depicted 
in FIG. 1, which illustrates a typical hardware configuration 
of a workstation in accordance with a preferred embodiment 
having a central processing unit 110, such as a 
microprocessor, and a number of other units interconnected 
via a system bus 112. The workstation shown in FIG. 1 
includes a Random Access Memory (RAM) 114, Read Only 
Memory (ROM) 116, an I/O adapter 118 for connecting 
peripheral devices such as disk storage units 120 to the bus 
112, a user interface adapter 122 for connecting a keyboard 
124, a mouse 126, a speaker 128, a microphone 132, and/or 
other user interface devices such as a touch screen (not 
shown) to the bus 112, communication adapter 134 for 
connecting the workstation to a communication network 
(e.g., a data processing network) and a display adapter 136 
for connecting the bus 112 to a display device 138. The 
workstation typically has resident thereon an operating 
system such as the Microsoft Windows NT or Windows/95 
Operating System (OS), the IBM OS/2 operating system, the 
MAC OS, or UNIX operating system. Those skilled in the 
art will appreciate that the present invention may also be 
implemented on platforms and operating systems other than 
those mentioned. 

A preferred embodiment is written using JAVA., C, and the 
C++ language and utilizes object oriented programming 
methodology. Object oriented programming (OOP) has 
become increasingly used to develop complex applications. 
As OOP moves toward the mainstream of software design 
and development, various software solutions require adap- 
tation to make use of the benefits of OOP. A need exists for 
these principles of OOP to be applied to a messaging 
interface of an electronic messaging system such that a set 
of OOP classes and objects for the messaging interface can 
be provided. 

OOP is a process of developing computer software using 
objects, including the steps of analyzing the problem, 
designing the system, and constructing the program. An 
object is a software package that contains both data and a 
collection of related structures and procedures. Since it 
contains both data and a collection of structures and 
procedures, it can be visualized as a self- sufficient compo- 
nent that does not require other additional structures, pro- 
cedures or data to perform its specific task. OOP, therefore, 
views a computer program as a collection of largely autono- 
mous components, called objects, each of which is respon- 
sible for a specific task. This concept of packaging data, 
structures, and procedures together in one component or 
module is called encapsulation. 

In general, OOP components are reusable software mod- 
ules which present an interface that conforms to an object 
model and which are accessed at run-time through a com- 
ponent integration architecture. A component integration 
architecture is a set of architecture mechanisms which allow 
software modules in different process spaces to utilize each 
others capabilities or functions. This is generally done by 
assuming a common component object model on which to 
build the architecture. 

It is worthwhile to differentiate between an object and a 
class of objects at this point. An object is a single instance 
of the class of objects, which is often just called a class. A 
class of objects can be viewed as a blueprint, from which 
many objects can be formed. 

OOP allows the programmer to create an object that is a 
part of another object. For example, the object representing 
a piston engine is said to have a composition- relationship 
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with the object representing a piston. In reality, a piston 
engine comprises a piston, valves and many other compo- 
nents; the fact that a piston is an element of a piston engine 
can be logically and semantically represented in OOP by two 
objects. 5 

OOP also allows creation of an object that "depends 
from" another object. If there are two objects, one repre- 
senting a piston engine and the other representing a piston 
engine wherein the piston is made of ceramic, then the 
relationship between the two objects is not that of compo- 10 
sition. A ceramic piston engine does not make up a piston 
engine. Rather it is merely one kind of piston engine that has 
one more limitation than the piston engine; its piston is made 
of ceramic. In this case, the object representing the ceramic 
piston engine is called a derived object, and it inherits all of 
the aspects of the object representing the piston engine and 15 
adds further limitation or detail to it. The object representing 
the ceramic piston engine "depends from" the object repre- 
senting the piston engine. The relationship between these 
objects is called inheritance. 

When the object or class representing the ceramic piston 
engine inherits all of the aspects of the objects representing 
the piston engine, it inherits the thermal characteristics of a 
standard piston defined in the piston engine class. However, 
the ceramic piston engine object overrides these ceramic 
specific thermal characteristics, which are typically different 
from those associated with a metal piston. It skips over the 
original and uses new functions related to ceramic pistons. 
Different kinds of piston engines have different 
characteristics, but may have the same underlying functions 
associated with it (e.g., how many pistons in the engine, 
ignition sequences, lubrication, etc.). To access each of these 
functions in any piston engine object, a programmer would 
call the same functions with the same names, but each type 
of piston engine may have different/overriding implemen- ^ 
tations of functions behind the same name. This ability to 
hide different implementations of a function behind the same 
name is called polymorphism and it greatly simplifies com- 
munication among objects. 

With the concepts of composition-relationship, 4Q 
encapsulation,' inheritance and polymorphism, an object can 
represent just about anything in the real world. In fact, our 
logical perception of the reality is the only limit on deter- 
mining the kinds of things that can become objects id 
object-oriented software. Some typical categories are as 
follows: 

Objects can represent physical objects, such as automo- 
biles in a traffic -flow simulation, electrical components 
in a circuit- design program, countries in an economics 
model, or aircraft in an air- traffic-control system. 50 

Objects can represent elements of the computer-user 
environment such as windows, menus or graphics 
objects. 

An object can represent an inventory, such as a personnel 
file or a table of the latitudes and longitudes of cities. 55 

An object can represent user-defined data types such as 
time, angles, and complex numbers, or points on the 
plane. 

With this enormous capability of an object to represent 
just about any logically separable matters, OOP allows the 60 
software developer to design and implement a computer 
program that is a model of some aspects of reality, whether 
that reality is a physical entity, a process, a system, or a 
composition of matter. Since the object can represent 
anything, the software developer can create an object which 65 
can be used as a component in a larger software project in 
the future. 
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If 90% of a new OOP software program consists of 
proven, existing components made from preexisting reus- 
able objects, then only the remaining 10% of the new 
software project has to be written and tested from scratch. 
Since 90% already came km an inventory of extensively 
tested reusable objects, the potential domain from which an 
error could originate is 10% of the program. As a result, 
OOP enables software developers to build objects out of 
other, previously built, objects. 

This process closely resembles complex machinery being 
built out of assemblies and sub-assemblies. OOP 
technology, therefore, makes software engineering more like 
hardware engineering in that software is built from existing 
components, which are available to the developer as objects. 
All this adds up to an improved quality of the software as 
well as an increased speed of its development. 

Programming languages are beginning to fully support the 
OOP principles, such as encapsulation, inheritance, 
polymorphism, and composition -relationship. With the 
advent of the C++ language, many commercial software 
developers have embraced OOP. C++ is an OOP language 
that offers a fast, machine- executable code. Furthermore, 
C++ is suitable for both commercial-application and 
systems-programming projects. For now, C++ appears to be 
the most popular choice among many OOP programmers, 
but there is a host of other OOP languages, such as 
Smalltalk, common lisp object system (CLOS), and Eiffel. 
Additionally, OOP capabilities are being added to more 
traditional popular computer programming languages such 
as Pascal. 

The benefits of object classes can be summarized, as 
follows: 

Objects and their corresponding classes break down com- 
plex programming problems into many smaller, sim- 
pler problems. 

Encapsulation enforces data abstraction through the orga- 
nization of data into small, independent objects that can 
communicate with each other. Encapsulation protects 
the data in an object from accidental damage, but 
allows other objects to interact with that data by calling 
the object's member functions and structures. 

Subclassing and inheritance make it possible to extend 
and modify objects through deriving new kinds of 
objects from the standard classes available in the sys- 
tem. Thus, new capabilities are created without having 
to start from scratch. 

Polymorphism and multiple inheritance make it possible 
for different programmers to mix and match character- 
istics of many different classes and create specialized 
objects that can still work with related objects in 
predictable ways. 

Class hierarchies and containment hierarchies provide a 
flexible mechanism for modeling real-world objects 
and the relationships among them. 

Libraries of reusable classes are useful in many situations, 
but they also have some limitations. For example: 

Complexity. In a complex system, the class hierarchies for 
related classes can become extremely confusing, with 
many dozens or even hundreds of classes. 

Flow of control. A program written with the aid of class 
libraries is still responsible for the flow of control (i.e., 
it must control the interactions among all the objects 
created from a particular library). The programmer has 
to decide which functions to call at what times for 
which kinds of objects. 

Duplication of effort. Although class libraries allow pro- 
grammers to use and reuse many small pieces of code, 
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each programmer puts those pieces together in a dif- 
ferent way. Two different programmers can use the 
same set of class libraries to write two programs that do 
exactly the same thing but whose internal structure 
(i.e., design) may be quite different, depending on 5 
hundreds of small decisions each programmer makes 
along the way. Inevitably, similar pieces of code end up 
doing similar things in slightly different ways and do 
not work as well together as they should. 
Class libraries are very flexible. As programs grow more 10 
complex, more programmers are forced to reinvent basic 
solutions to basic problems over and over again. A relatively 
new extension of the class library concept is to have a 
framework of class libraries. This framework is more com- 
plex and consists of significant collections of collaborating is 
classes that capture both the small scale patterns and major 
mechanisms that implement the common requirements and 
design in a specific application domain. They were first 
developed to free application programmers from the chores 
involved in displaying menus, windows, dialog boxes, and 20 
other standard user interface elements for personal comput- 
ers. 

Frameworks also represent a change in the way program- 
mers think about the interaction between the code they write 
and code written by others. In the early days of procedural 25 
programming, the programmer called libraries provided by 
the operating system to perform certain tasks, but basically 
the program executed down the page from start to finish, and 
the programmer was solely responsible for the flow of 
control. This was appropriate for printing out paychecks, 30 
calculating a mathematical table, or solving other problems 
with a program that executed in just one way. 

The development of graphical user interfaces began to 
turn this procedural programming arrangement inside out. 
These interfaces allow the user, rather than program logic, to 35 
drive the program and decide when certain actions should be 
performed. Today, most personal computer software accom- 
plishes this by means of an event loop which monitors the 
mouse, keyboard, and other sources of external events and 
calls the appropriate parts of the programmer's code accord- 40 
ing to actions that the user performs. The programmer no 
longer determines the order in which events occur. Instead, 
a program is divided into separate pieces that are called at 
unpredictable times and in an unpredictable order. By relin- 
quishing control in this way to users, the developer creates 45 
a program that is much easier to use. Nevertheless, indi- 
vidual pieces of the program written by the developer still 
call libraries provided by the operating system to accomplish 
certain tasks, and the programmer must still determine the 
flow of control within each piece after being called by the 50 
event loop. Application code still "sits on top of the system. 

Even event loop programs require programmers to write 
a lot of code that should not need to be written separately for 
every application. The concept of an application framework 
carries the event loop concept further. Instead of dealing 55 
with all the nuts and bolts of constructing basic menus, 
windows, and dialog boxes and then making these things all 
work together, programmers using application frameworks 
start with working application code and basic user interface 
elements in place. Subsequently, they build from there by 60 
replacing some of the generic capabilities of the framework 
with the specific capabilities of the intended application. 

Application frameworks reduce the total amount of code 
that a programmer has to write from scratch. However, 
because the framework is really a generic application that 65 
displays windows, supports copy and paste, and so on, the 
programmer can also relinquish control to a greater degree 



than event loop programs permit. The framework code takes 
care of almost all event handling and flow of control, and the 
programmer's code is called only when the framework 
needs it (e.g., to create or manipulate a proprietary data 
structure). 

A programmer writing a framework program not only 
relinquishes control to the user (as is also true for event loop 
programs), but also relinquishes the detailed flow of control 
within the program to the framework. This approach allows 
the creation of more complex systems that work together in 
interesting ways, as opposed to isolated programs, having 
custom code, being created over and over again for similar 
problems. 

Thus, as is explained above, a framework basically is a 
collection of cooperating classes that make up a reusable 
design solution for a given problem domain. It typically 
includes objects that provide default behavior (e.g., for 
menus and windows), and programmers use it by inheriting 
some of that default behavior and overriding other behavior 
so that the framework calls application code at the appro- 
priate times. 

There are three main differences between frameworks and 
class libraries: 3 

Behavior versus protocol. Gass libraries are essentially 
collections of behaviors that you can call when you 
want those individual behaviors in your program. A 
framework, on the other hand, provides not only behav- 
ior but also the protocol or set of rules that govern the 
ways in which behaviors can be combined, including 
rules for what a programmer is supposed to provide 
versus what the framework provides. 

Call versus override. With a class library, the code the 
programmer instantiates objects and calls their member 
functions. It's possible to instantiate and call objects in 
the same way with a framework (i.e., to treat the 
framework as a class library), but to take full advantage 
of a framework's reusable design, a programmer typi- 
cally writes code that overrides and is called by the 
framework. The framework manages the flow of con- 
trol among its objects. Writing a program involves 
dividing responsibilities among the various pieces of 
software that are called by the framework rather than 
specifying how the different pieces should work 
together. 

Implementation versus design. With class libraries, pro- 
grammers reuse only implementations, whereas with 
frameworks, they reuse design. Aframework embodies 
the way a family of related programs or pieces of 
software work. It represents a generic design solution 
that can be adapted to a variety of specific problems in 
a given domain. For example, a single framework can 
embody the way a user interface works, even though 
two different user interfaces created with the same 
framework might solve quite different interface prob- 
lems. 

Thus, through the development of frameworks for solu- 
tions to various problems and programming tasks, signifi- 
cant reductions in the design and development effort for 
software can be achieved. A preferred embodiment of the 
invention utilizes HyperText Markup Language (HTML) to 
implement documents on the Internet together with a 
general-purpose secure communication protocol for a trans- 
port medium between the client and the Newco. HTTP or 
other protocols could be readily substituted for HTML 
without undue experimentation. Information on these prod- 
ucts is available in T Berners-Lee, D. Connoly, "RFC 1866: 
Hypertext Markup Language— 2.0" (Nov. 1995); and R. 
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Fielding, H, Frystyk, T. Berners-Lee, J. Gettys and J. C. being supported by over 100 companies. Trie group's build- 
Mogul, "Hypertext Transfer Protocol — HTTP/1.1: HTTP ing blocks are called ActiveX Controls, small, fast compo- 
Working Group Internet Draft" (May 2, 1996). HTML is a nents that enable developers to embed parts of software in 
simple data format used to create hypertext documents that hypertext markup language (HTML) pages. ActiveX Con- 
are portable from one platform to another. HTML docu- 5 trok WOfk with a yafi of programming i angU a g es inchid- 
ments are SGML documents with generic semantics that are ^ ^ c Borland MicrQsof( ^ 
appropriate for representing information from a wide range * , . , ■ , / 
of domains. HTML has been in use by the World-Wide Web Basic Programming system and, in the future, Microsoft s 
global information initiative since 1990. HTML is an appli- development tool for Java, code named "Jakarta." ActiveX 
cation of ISO Standard 8879:1986 Information Processing 10 Technologies also includes ActiveX Server Framework, 
Text and Office Systems; Standard Generalized Markup allowing developers to create server applications. One of 
Language (SGML). ordinary skill in the art readily recognizes that ActiveX 
To date, Web development tools have been limited in their could be substituted for JAVA without undue experimenta- 
ability to create dynamic Web applications which span from (i on t 0 practice the invention. 

client to server and interoperate with existing computing 15 [ n accordance wim a preferred embodiment, Background- 
resources. Until recently HlTvlL has been the dominant Hnder (BF) is ^ lemented ^ aQ agent responsible for 

technology used in development of Web-based solutions. . . ... , f . , « , . 

TT ™ mt i_ . t_ • j . • *l r i preparing an individual lor an upcoming meeting by helping 

However, HTML has proven to be inadequate in the fol- f . „ . , . r • * i • 

lowing areas* him/her retrieve relevant information about the meeting 

n - nn from various sources. BF receives input text in character 

Poor performance; 20 „ ... 

„ . A . . f , „. . form indicative of the target meeting. The input text is 

Restncted user interlace capabilities; , . , . t 

_ . , . „_ , generated m accordance with a prelerred embodiment by a 

Can only produce static Web pages; T - . . « , t . - A 

J r . . . ^ calendar program that mcludes the time of the meetmg. As 

Lack of interoperability with existing applications and lL 4 . rtL 4 . , tL , , 

data' and e ° meeting approaches, the calendar program is 

T , , 25 queried to obtain the text of the target event and that 

Inability to scale. ? , ^ 

Sun Microsystem's Java language solves many of the ^formation is utilized as input to the agent. Then, the agent 

client-side problems by: P arses the ™V ui meetin S text t0 extract its various ^P 0 " 

Improving performance on the client side; nents such as title > bodv > Participants, location, time etc. The 

Enabling the creation of dynamic, real-time Web appli- 30 system also performs pattern matching to identify particular 

cations' and meeting fields in a meeting text. This information is utilized 

Providing the ability to create a wide variety of user t0 query various sources of information on the web and 

interface components. obtain relevant stories about the current meeting to send 

With Java, developers can create robust User Interface back to the calendaring system. For example, if an indi- 

(UI) components. Custom "widgets" (e.g. real-time stock 35 vidual has a meeting with Netscape and Microsoft to talk 

tickers, animated icons, etc.) can be created, and client-side about their disputes, and would obtain this initial informa- 

performance is improved. Unlike HTML, Java supports the ^on from the calendaring system. It will then parse out the 

notion of client-side validation, offloading appropriate pro- text {Q r ^ ^ ^ anies in lhe meeti are 

cessing onto the client for improved performance. Dynamic, UXT . „ , « w . £ ,„ A . • . . „ 

i . -rm j i * f j tt • .l i_ Netscape and Microsoft and the topic is disputes, 

real-time Web pages can be created. Using the above- 40 * . r . r . 

mentioned custom UI components, dynamic Web pages can ™ en > the s y stem 1 uenes lhe web for relevant ">f°™^°° 

also be created concerning the topic. Thus, in accordance with an objective 

Sun's Java language has emerged as an industry- of the invention, the system updates the calendaring system 

recognized language for "programming the Internet/' Sun and eventually the user with the best information it can 

defines Java as: "a simple, object-oriented, distributed, 45 g ather t0 prepare the user for the target meeting. In accor- 

interpreted, robust, secure, architecture-neutral, portable, dance with a preferred embodiment, the information is 

high-performance, multithreaded, dynamic, buzzword- stored in a file that is obtained via selection from a link 

compliant, general-purpose programming language. Java imbedded in the calendar system, 
supports programming for the Internet in the form of 

platform-independent Java applets." Java applets are small, 50 Program Organization 
specialized applications that comply with Sun's Java Appli- 
cation Programming Interface (API) allowing developers to A computer program in accordance with a preferred 
add "interactive content" to Web documents (e g. simple embodiment is organized in five distinct modules: BF.Main, 
animations page adornments, basic games etc.) Applets BRPaise Background Finder.Error, BF.PatternMatching 
execute within a Java-compatible ; browser (e.g. Netscape 55 and BRSearch ^ ere fc also a frmMain which ides a 

Navigator) by copying code from the server to client. From . . c , , c , , ™ 

e> y ; , r . f . , c ^ t . , , user interface used only for debugging purposes. The 

a language standpoint, Java s core feature set is based on , , , .7; c , . ,. 

C++. Sun's Java literature states that Java is basically "C++, P ro ^™ s m accordance with a preferred embodi- 

with extensions from Objective C for more dynamic method mem Dever tx ?»* Wlth the user sh ° uld °^ 

resolution" 60 return to me calendaring system through Microsoft's Win- 

Another technology that provides similar function to sock control. A preferred embodiment of the system 

JAVA is provided by Microsoft and ActiveX Technologies, executes in two different modes which can be specified 

to give developers and Web designers wherewithal to build under the command line sent to it by the calendaring system, 

dynamic content for the Internet and personal computers. When the system runs in simple mode, it executes a keyword 

ActiveX includes tools for developing animation, 3-D vir- 65 query to submit to external search engines. When executed 

tual reality, video and other multimedia content. The tools in complex mode, the system performs pattern matching 

use Internet standards, work on multiple platforms, and are before it forms a query to be sent to a search engine. 
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Data Structures 



The system in accordance with a preferred embodiment 
utilizes three user defined structures: 

1. TMeetingRecord; 

2. TPatternElement; and 

3. TPatternRecord. 

The user-defined structure, tMeetingRecord, is used to store 
all the pertinent information concerning a single meeting. 
This info includes userlD, an original description of the 
meeting, the extracted fist of keywords from the title and 
body of meeting etc. It is important to note that only one 
meeting record is created per instance of the system in 
accordance with a preferred embodiment. This is because 
each time the system is spawned to service an upcoming 
meeting, it is assigned a task to retrieve information for only 
one meeting. Therefore, the meeting record created corre- 
sponds to the current meeting examined. ParseMeetingText 
populates this meeting record and it is then passed around to 
provide information about the meeting to other functions. 
If GoPatternMatch can bind any values to a particular 
meeting field, the corresponding entries in the meeting 
record is also updated. The structure of tMeetingRecord with 
each field described in parentheses is provided below in 
accordance with a preferred embodiment. 



A.l. 1.1.1.1 
sUscrlD As String 
sTTtleOrig As String 

sTitleKW As String 
sBodyKw As String 
sCompanyO As String 
matching) 
slbpicO As String 
matching) 
sPeopleO As String 
matching) 
sWhenO As String 

sWheref) As String 
matching) 

sLocation As String 
sUme As String 
sParticipantsQ As 
String 

sMeetingText As 

String 

EndType 
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Public Type tMeetingRecord 
(user id given by Munin) 
(original non stop listed title we need to keep 
around to send back to Munin) 
(stoplistcd title with only keywords) 
(stoplisted body with only keywords) 
(companys identified in title or body through 
pattern 

(topics identified in title or body through pattern 

(people identified in title or body through pattern 

(time identified in title or body through pattern 
matching) 

(location identified in title or body through pattern 

(location as passed in by Munin) 

(time as passed in by Munin) 

(all participants engaged as passed in by Munin) 

(the origin meeting text w/o userid) 
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There are two other structures which are created to hold 
each individual pattern utilized in pattern matching. The 
record tAPatternRecord is an array containing all the 
components/elements of a pattern. The type tAPatternEle- 
ment is an array of strings which represent an element in a 
pattern. Because there may be many "substitutes" for each 
element, we need an array of strings to keep track of what 
all the substitutes are. The structures of tAPatternElement 
and tAPatternRecord are presented below in accordance 
with a preferred embodiment. 
Public Type tAPatternElement 

elementArray( ) As String 
End Type 

Public Type tAPatternRecord 

patternArray( ) As tAPatternElement 
End Type 

Common User Defined Constants 

Many constants are defined in each declaration section of 
the program which may need to be updated periodically as 
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part of the process of maintaining the system in accordance 
with a preferred embodiment. The constants are accessible 
to allow dynamic configuration of the system to occur as 
updates for maintaining the code. 



Included in the following tables are lists of constants from 
each module which I. thought are most likely to be modified 
from time to time. However, there are also other constants 
used in the code not included in the following list. It does not 
mean that these non-included constants will never be 
changed. It means that they will change much less fre- 
quently. 



Fpr the Main Module (BF.Main): 
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CONSTANT 



PRESET 
VALUE USE 
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MSGTOMUNIN_TYFE 
IP^VDDRESS_MUNIN 

PORT_MUNIN 
TTMEOUT_AV 
TIMEOUT_NP 
CMD_SEPARATOR 



OUTPARAM_SEPARAT 
OR 
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6 Define the message number 
used to identify messages 
between BF and Munin 
"10.Z Define the IP address of the 
100.48" machine in which Munin and 
BF are running on so they can 
transfer data through UDP. 
7777 Define the remote port in 
which we are operating on. 
60 Define constants for setting 

time out in inet controls 
60 Define constants for setting 
time out in inet controls 
*[|]P' Define delimiter to tell 

which part of Munin* s command 
represents the beginning of our 
input meeting text 
"::" Define delimiter for separating 
out different portions of 
the output. 
The separator is for 
delimiting the 
msg type, the user id, 
the meeting 

title and the beginning of the 
actual stories retrieved. 
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For the Search Module (BF.Search): 



CUR- 
RENT 

CONSTANT VALUE USE 



PAST_ 
NDAYS 
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CONNECTOR^ 
AV_URL 



CONNECTOR^ 
NP_URL 



NUM_ 
NP_STORIES 



5 Define number of days you want to 

look back for AltaVista articles. 
Doesn't really matter now because 
we aren't really doing a news 
search in alta vista. We want all 
info. 

"+AND+" Define how to connect keywords. 

We want alt our keywords in the 
string so for now use AND. If you 
want to do an OR or something, 
just change connector. 

"+AND+" Define how to connect keywords. 

We want all our keywords in the 
string so for now use AND. If you 
want to do an OR or something, 
just change connector. 

3 Define the number of stories to 

return back to Munin from 
News Page. 
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For the Search Module (BF.Seaich): 

CUR- 
RENT 

CONSTANT VALUE USE 



NUM_ 3 Define the number of stories to 

AV„STORIES return back to Munin from 

AltaVista. 



For the Parse Module fBF Parsed 



CUR- 
RENT 

CONSTANT VALUE USE 



PORTION. 


Define the separator between 


SEPARATOR 


different portions of the meeting 




text sent in by Munin. For example 




in "09::Meet with Chad::about 




life::Chad|Denise: is the 




separator between different parts 




of the meeting text. 


PARTICIPANT. *i" 


Define the separator between each 


SEPARATOR 


participant in the participant list 




portion of the original meeting 




text- 




Refer to example above. 



For Pattern Matching Module (BFPatternMatch): There 
are no constants in this module which require frequent 
updates. 

General Process Flow 

The best way to depict the process flow and the coordi- 
nation of functions between each other is with the five 
flowcharts illustrated in FIGS. 2 to 6. FIG. 2 depicts the 
overall process flow in accordance with a preferred embodi- 
ment. Processing commences at the top of the chart at 
function block 200 which launches when the program starts. 
Once the application is started, the command line is parsed 
to remove the appropriate meeting text to initiate the target 
of the background find operation in accordance with a 
preferred embodiment as shown in function block 210. A 
global stop list is generated after the target is determined as 
shown in function block 220. Then, all the patterns that are 
utilized for matching operations are generated as illustrated 
in function block 230. Then, by tracing through the chart, 
function block 200 invokes GoBF 240 which is responsible 
for logical processing associated with wrapping the correct 
search query information for the particular target search 
engine. For example, function block 240 flows to function 
block 250 and it then calls GoPatteraMatch as shown in 
function block 260. To see the process flow of 
GoPatternMatch, we swap to the diagram titled "Process 
Flow for BF's Pattern Matching Unit." 

One key thing to notice is that functions depicted at the 
same level of the chart are called by in sequential order from 
left to right (or top to bottom) by their common parent 
function. For example, Main 200 calls ProcessCommand- 
Line 210, then CreateStopListist 220, then CreatePatterns 
230, then GoBackgroundFinder 240. FIGS. 3 to 6 detail the 
logic for the entire program, the parsing unit, the pattern 
matching unit and the search unit respectively. FIG. 6 details 
the logic determinative of data flow of key information 
through BackgroundFinder, and shows the functions that are 
responsible for creating or processing such information. 
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Detailed Search Architecture Under the Simple 
Query Mode 

Search Alta Vista 

(Function block 270 of FIG. 2) 

The Alta Vista search engine utilizes the identifies and 
returns general information about topics related to the cur- 
rent meeting as shown in function block 270 of FIG. 2. The 

10 system in accordance with a preferred embodiment takes all 
the keywords from the title portion of the original meeting 
text and constructs an advanced query to send to Alta Vista. 
The keywords are logically combined together in the query. 
The results are also ranked based on the same set of 

!5 keywords. One of ordinary skill in the art will readily 
comprehend that a date restriction or publisher criteria could 
be facilitated on the articles we want to retrieve. A set of top 
ranking stories are returned to the calendaring system in 
accordance with a preferred embodiment. 

20 News Page 

(Function block 275 of FIG. 2) 

The NewsPage search system is responsible for giving us 

25 the latest news topics related to a target meeting. The system 
takes all of the keywords from the title portion of the original 
meeting text and constructs a query to send to the NewsPage 
search engine. The keywords are logically combined 
together in the query. Only articles published recently are 

3Q retrieved. The Newspage search system provides a date 
restriction criteria that is settable by a user according to the 
user's preference. The top ranking stories are returned to the 
calendaring system. 

FIG. 3 is a user profile data model in accordance with a 

35 preferred embodiment. Processing commences at function 
block 300 which is responsible for invoking the program 
from the main module. Then, at function block 310, a 
wrapper function is invoked to prepare for the keyword 
extraction processing in function block 320. After the key- 

40 words are extracted, then processing flows to function block 
330 to determine if the delimiters are properly positioned. 
Then, at function block 340, the number of words in a 
particular string is calculated and the delimiters for the 
particular field are and a particular field from the meeting 

45 text is retrieved at function block 350. Then, at function 
block 380, the delimiters of the string are again checked to 
assure they are placed appropriately. Finally, at function 
block 360, the extraction of each word from the title and 
body of the message is performed a word at a time utilizing 

50 the logic in function block 362 which finds the next closest 
word delimiter in the input phrase, function block 364 which 
strips unnecessary materials from a word and function block 
366 which determines if a word is on the stop list and returns 
an error if the word is on the stop list. 

55 Pattern Matching in Accordance with a Preferred 
Embodiment 

The limitations associated with a simple searching 
method include the following: 
60 1- Because it relies on a stoplist of unwanted words in 
order to extract from the meeting text a set of 
keywords, it is limited by how comprehensive the 
stoplist is. Instead of trying to figure out what parts of 
the meeting text we should throw away, we should 
65 focus on what parts of the meeting text we want. 

2. A simple search method in accordance with a preferred 
embodiment only uses the keywords from a meeting 
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title to form queries to send to Alta Vista and News- 
Page. This ignores an alternative source of information 
for the query, the body of the meeting notice. We cannot 
include the keywords from the meeting body to form 
our queries because this often results in queries which 
are too long and so complex that we often obtain no 
meaningful results. 

3. There is no way for us to tell what each keyword 
represents. For example, we may extract "Andy" and 
"Grove" as two keywords. However, a simplistic 
search has no way knowing that "Andy Grove" is in 
fact a person's name. Imagine the possibilities if we 
could somehow intelligently guess that "Andy Grove" 
is a person's name. We can find out if he is an Andersen 
person and if so what kind of projects he's been on 
before etc. etc. 

4. In summary, by relying solely on a stoplist to parse out 
unnecessary words, we suffer from "information over- 
load". 

Pattern Matching Overcomes These Limitations in 
Accordance with a Preferred Embodiment 

Here's how the pattern matching system can address each 
of the corresponding issues above in accordance with a 
preferred embodiment. 

1 . By doing pattern matching, we match up only parts of 
the meeting text that we want and extract those parts. 

2. By performing pattern matching on the meeting body 
and extracting only the parts from the meeting body 
that we want, our meeting body will not go to complete 
waste. 

3. Pattern matching is based on a set of templates that we 
specify, allowing us to identify people names, company 
names, etc. from a meeting text. 

4. in summary, with pattern matching, we no longer suffer 
from information overload. Of course, the big problem 
is how well our pattern matching works. If we rely 
exclusively on artificial intelligence processing, we do 40 
not have a 100% hit rate. We are able to identify about 
20% of all company names presented to us. 

Patterns 

A pattern in the context of a preferred embodiment is a 45 
template specifying the structure of a phrase we are looking 
for in a meeting text. The patterns supported by a preferred 
embodiment are selected because they are templates of 
phrases which have a high probability of appearing in 
someone's meeting text. For example, when entering a 
meeting in a calendar, many would write something such as 
"Meet with Bob Dutton from Stanford University next 
Tuesday." A common pattern would then be something like 
the word "with" followed by a person's name (in this 
example it is Bob Dutton) followed by the word "from" and 
ending with an organization's name (in this case, it is 
Stanford University). 

Pattern Matching Terminology 

60 

The common terminology associated with pattern match- 
ing is provided below. 

Pattern: a pattern is a template specifying the structure of 
a phrase we want to bind the meeting text to. It contains 
sub units. 6 5 

Element: a pattern can contain many sub-units. These 
subunits are called elements. For example, in the pat- 
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tern "with $PEOPLE$ from $COMPANY$", "with" 
"$PEOPLE$" "from" "$COMPANY$" are all ele- 
ments. 

Placeholder: a placeholder is a special kind of element in 
which we want to bind a value to. Using the above 
example, "$PEOPLE$" is a placeholder. 

Indicator: an indicator is another kind of element which 
we want to find in a meeting text but no value needs to 
bind to it. There may be often more than one indicator 
we are looking for in a certain pattern. That is why an 
indicator is not an "atomic" type. 

Substitute: substitutes are a set of indicators which are alt 
synonyms of each other. Finding any one of them in the 
input is good. 

There are five fields which are identified for each meeting: 



♦ Company (SCOMPANYS) 

♦ People ($PEOPLE$) 

♦ Location ($LOCATION$) 

♦ Time ($TJME$) 

♦ Topic ($TOPIC_UPPER$) or ($TOPIC_^UX$) 



In parentheses are the placeholders I used in my code as 
representation of the corresponding meeting fields. 
Each placeholder has the following meaning: 

$COMPANY$: binds a string of capitalized words (e.g. 

Meet with Joe Carter of <Andersen Consulting>) 
$PEOPLE$: binds series of string of two capitalized 

words potentially connected by "and" or (e.g. 

Meet with <Joe Carter>of Andersen Consulting, Meet 

with <Joe Carter and Luke Hughes> of Andersen 

Consulting) 

$LOCATION$: binds a string of capitalized words (e.g. 
Meet Susan at <Palo Alto Square >) 

STIMES: binds a string containing the format #:## (e.g. 

Dinner at <6:30 pm>) 
STOPIC__UPPER$: binds a string of capitalized words 
for our topic (e.g. <Stanford Engineering Recruiting> 
Meeting to talk about new hires). 
$TOPIC_ALL$: binds a string of words without really 
caring if it's capitalized or not. (e.g. Meet to talk about 
<ubiquitous computing>) 
Here is a table representing all the patterns supported by BE 
Each pattern belongs to a pattern group. All patterns within 
a pattern group share a similar format and they only differ 
from each other in terms of what indicators are used as 
substitutes. Note that the patterns which are grayed out are 
also commented in the code. BF has the capability to support 
these patterns but we decided that matching these patterns is 
not essential at this point. 





PAT 






PAT 


PAT- 






GRP 


# 


TERN 


EXAMPLE 


1 


a 


$PEOPLE$ of 


Paul Maritz of Microsoft 






$COMPANY$ 






b 


$PEOPLE$ from 


Bill Gates, Paul Allen and 






$COMPANY$ 


Paul Maritz from Microsoft 


2 


a 


$TOPIC_UPPER$ meeting Push Technogy Meeting 




b 


$TOPIC_UPPER$ mtg 


Push Technology Mtg 
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PAT 


PAT- 






GRP 


# 


TERN 


IlAAMrJLll 




c 


£TOPrC UPPFRS demo 


Pi i c Vi TWr'fi n nl o crv H^ttio 




d 


$TOP[C UPPER$ 


Push Technology interview 












C 




Push .technology 






presentation 


p res entfl tio n 




f 




L LI Ail xCVllllUlUKY Vloll- 




£ 


$TOP[C_UPPER$ briefing 


Push Technology briefing 






atopic rrppFTJi; 


Push Technology 






dis cussio n 


d iscus sio n 








Push Technology 






workshop 


workshop 




• 
J 


$TOPIC_UPPER$ prep 


Push Tehnology prep 




k 


$TOP[C UPPER$ review 






I 


$TOPIC„UPPER$ lunch 


Push Technology lunch 






$TOPIC UPPERS project 


Push Technology project 






$TOPlC UPPER$ projects 


Push Technology projects 


3 




$COMPANY$ corporation 


Intel Corporation 




b 


$COMPANY$ corp 


IBM Corp 






$COMPANY$ systems 








$COMPANY$ limited 


IBM limited 






$COMPANY$ ltd 


IBM Ltd 


4 


a 


about $TOPIC ALLS 


About intelligent agents 








technology 




b 


discuss $ IX) PIC ALLS 


Discuss intelligent agents 








te chno logy 




c 


show $TOPIC ALL$ 


Show the client our 








intelligent agents 








t ^ r*h ti 1 n crv 
tC L.1111U IUl y 






Te- ATOPIC AT T $ 


re : intelligent agents 








te chno logy 






ICV LCW JUVJrlV^ /\ 1_JaD 


Review intelligent agents 








technology 






a genus 


The agenda is as follows: 








clean up 








clean up 








clean up 




8 


a genua. i> i writ^„.y\i vi ^ 


Agenda : 








demo client intelligent 








agents technology. 








demo ecommerce. 


5 


a 


w/$PEOPLE$ of 


Meet w/Joe Carter of 






$COMPANY$ 


Andersen Consulting 




b 


w/$PEOPLFS from 


Meet w/Joe Carter from 






$COMPANY$ 


Andersen Consulting 


6 


a 


w/$COMPANY$ per 


Talk w/Intel per Jason 






$PEOPLB$ 


Foster 


7 


a 


At $TTME$ 


at 3:00pm 




b 


Around $TIME$ 


Around 3:00pm 


8 


a 


At $LOCATION$ 


At LuLu's resturant 




b 


In $LOCATION$ 


in Santa Clara 


9 


a 


Per $PEOPLE$ 


per Susan Butler 


10 


a 


call w/$PEOPLE$ 


Conf call w/Tohn Smith 




B 


call with $PEOPLE$ 


Conf call with John Smith 


11 


A 


prep for $TOPICALL$ 


Prep for London meeting 




B 


preparation for 


Preparation for London 






$TOPIC„ALL$ 


meeting 



FIG. 4 is a detailed flowchart of pattern matching in 
accordance with a preferred embodiment. Processing com- 
mences at function block 400 where the main program 
invokes the pattern matching application and passes control 
to function block 410 to commence the pattern match 
processing. Then, at function block 420, the wrapper func- 
tion loops through to process each pattern which includes 
determining if a part of the text string can be bound to a 
pattern as shown in function block 430. Then, at function 
block 440, various placeholders are bound to values if they 
exist, and in function block 441, a list of names separated by 
punctuation are bound, and at function block 442 a full name 
is processed by finding two capitalized words as a full name 
and grabbing the next letter after a space after a word to 
determine if it is capitalized. Then; at function block 443, 
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time is parsed out of the string in an appropriate manner and 
the next word after a blank space in function block 444. 
Then, at function block 445, the continuous phrases of 
capitalized words such as company, topic or location are 
bound and in function block 446, the next word after the 
blank is obtained for further processing in accordance with 
a preferred embodiment. Following the match meeting field 
processing, function block 450 is utilized to loacte an 
indicator which is the head of a pattern, the next word after 
the blank is obtained as shown in function block 452 and the 
word is checked to determine if the word is an indicator as 
shown in function block 454. Then, at function block 460, 
the string is parsed to locate an indicator which is not at the 
end of the pattern and the next word after unnecessary white 
space such as that following a line feed or a carriage return 
is processed as shown in function block 462 and the word is 
analyzed to determine if it is an indicator as shown in 
function block 464. Then, in function block 470, the tem- 
porary record is reset to the null set to prepare it for 
processing the next string and at function block 480, the 
meeting record is updated and at function block 482 a check 
is performed to determine if an entry is already made to the 
meeting record before parsing the meeting record again. 

Using the Identified Meeting Fields 

Now that we have identified fields within the meeting text 
which we consider important, there are quite a few things we 
can do with it. One of the most important applications of 
pattern matching is of course to improve the query we 
construct which eventually gets submitted to Alta Vista and 
News Page. There are also a lot of other options and 
enhancements which exploit the results of pattern matching 
that we can add to BF. These other options will be described 
in the next section. The goal of this section is to give the 
reader a good sense of how the results obtained from pattern 
matching can be used to help us obtain better search results. 

FIG. 5 is a flowchart of the detailed processing for 
preparing a query and obtaining information from the Inter- 
net in accordance with a preferred embodiment. Processing 
commences at function block 500 and immediately flows to 
function block 510 to process the wrapper functionality to 
prepare for an Internet search utilizing a web search engine. 
If the search is to utilize the Alta Vista search engine, then 
at function block 530, the system takes information from the 
meeting record and forms a query in function blocks 540 to 
560 for submittal to the search engine. If the search is to 
utilize the NewsPage search engine, then at function block 
520, the system takes information from the meeting record 
and forms a query in function blocks 521 to 528. 

Alta Vista Search Engine 

The strength of the Alta Vista search engine is that it 
provides enhanced flexibility. Using its advance query 
method, one can construct all sorts of Boolean queries and 
rank the search however you want. However, one of the 
biggest drawbacks with Alta Vista is that it is not very good 
at handling a large query and is likely to give back irrelevant 
results. If we can identify the topic and the company within 
a meeting text, we can form a pretty short but comprehen- 
sive query which will hopefully yield better results. We also 
want to focus on the topics found. It may not be of much 
merit to the user to find out info about a company especially 
if the user already knows the company well and has had 
numerous meetings with them. It's the topics they want to 
research on. 

News Page Search Engine 

The strength of the News Page search engine is that it 
does a great job searching for the most recent news if you are 
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able to give it a valid company name. Therefore when we 
submit a query to the news page web site, we send whatever 
company name we can identify and only if we cannot find 
one do we use the topics found to form a query. If neither one 
is found, then no search is performed. The algorithmn 
utilized to form the query to submit to Alta Vista is illus- 
trated in FIG. 7. The algorithmn that we will use to form the 
query to submit to News Page is illustrated in FIG. 8. 
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The following table describes in detail each function in 
accordance with a preferred embodiment. The order in 
which functions appear mimics the process flow as closely 
as possible. When there are situations in which a function is 
called several times, this function will be listed after the first 
function which calls it and its description is not duplicated 
after every subsequent function which calls it. 



Procedure Name 



Type 



Called By 



Description 



Main 
(BF.Main) 

ProcessCommandLine 
(BF.Main) 

CreateS top List 
(BF.Main) 

CreatePatterns 
(BEPattern Match) 



Public 
Sub 



Private 
Sub 



Private 
Function 



Public 
Sub 



GoBF 
(BF.Main) 

Pars eMeetingText 
(BE Parse) 



FormatDel imitation 
(BEParse) 



DetermineNumWords 
(BEParse) 



GetAWoidFromString 
(BEParse) 



Private 



Parse AndClean Phrase 
(BEParse) 



Main 



Main 



Main 



Public 
Sub 



Public Go BackGroundFinder 
Function 



Pars eMeetingText, 
DetermineNumWords, 
GetAWordFr o mString 



Public Pars eMeetingText, 
Function Pro ccssS top List 



Public Pars eMeetingText, 
Function 

ProcessStopUst 



Private Pars eMeetingText 
Function 



This is the main function where the program first launches, [t 
initializes BF with the appropriate parameters (e.g. Internet time- 
out, stoplist...) and calls GoBF to launch the main part of the program. 
This function parses the command line. It assumes that the delimiter 
indicating the beginning of input from Munin is stored in the constant 
CMD_SEPARATOR. 

This function sets up a stop list for future use to parse out unwanted 
words from the meeting text. There are commas on each side of each 
word to enable straight checking. 

This procedure is called once when BF is first initialized to create all 
the potential patterns that portions of the meeting text can bind to. 
A pattern can contain however many elements as needed. There are two 
types of elements. The first type of elements are indicators. These are 
real words which delimit the potential of a meeting field (eg company) 
to follow. Most of these indicators arc stop words as expected because 
stop words are words usually common to all meeting text so it makes 
sense they form patterns. The second type of elements arc special 
strings which represent placeholders. A placeholder is always in the 
form of $*$ where * can be either PEOPLE, COMPANY, 
TOPIC_UPPER, TIME, LOCATION or TOPIC _ALL. A pattern can 
begin with either one of the two types of elements and can be however 
long, involving however any number/type of elements. This procedure 
dynamically creates a new pattern record for each pattern in the table 
and it also dynamically creates new tAPatternElements for each element 
within a pattern. In addition, there is the concept of being able to 
substitute indicators within a pattern. For example, the pattern 
$PEOPLE$ of $COMPANY$ is similar to the pattern $PEOPLE$ from 
$COMPANY$. "from" is a substitute for "of. Our structure should 
be able to express such a need for substitution. 
This is a wrapper procedurer that calls both the parsing and the 
searching subroutines of the BF. It is also responsible for sending 
data back to Munin. 

This function takes the initial meeting text and identifies the userlD of 
the record as well as other parts of the meeting text including the title, 
body, participant list, location and time. In addition, we call a helper 
function ProcessStopList to eliminate all the unwanted words from the 
original meeting title and meeting body so that only keywords are left. 
The information parsed out is stored in the MeetingRecord structure. 
Note that this function does no error checking and for the most time 
assumes that the meeting text string is correctly formatted by Munin. 
The important variable is this Meeting Record is the temp holder for all 
info regarding current meeting. Its eventually returned to caller. 
There are 4 ways in which the delimiters can be placed. We take care 
of all these cases by reducing them down to Case 4 in which there 
are no delimiters around but only between fields in a string (e.g. 
A::B::C) 

This functions determines how many words there are in a string 

(stlnEval String) The function assumes that each word is separated by a 
designated separator as specified in stSeparator. The return type is an 
integer that indicates how many words have been found assuming each 
word in the string is separated by stSeparator. This function is always 
used along with GetAWordFromString and should be called before 
calling GetAWordFrom String. 

This function extracts the ith word of the string(stlnEvalstiing) 
assuming that each word in the string is separated by a designated 
separator contained in the variable stSeparator. In most cases, use 
this function with DetennineNum Words. The function returns the 
Wanted word. This function checks to make sure that ilnWordNum is 
within bounds so that i is not greater than the total number of words in 
string or less than/equal to zero. If it is out of bounds, we return empty 
string to indicate we can't get anything. We try to make sure this 
doesn't happen by calling DetermineNumWords first. 
This function first grabs the word and send it to CteanWord in order 
strip the stuff that nobody wants. There are things in parseWbrd that 
will kill the word, so we will need a method of looping through the 
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-continued 



Procedure Name 



Type 



Called By 



Description 



FindMin 
(BRParse) 



Clean Word 
(BRParse) 



EvaluateWord 
(BRParse) 



GoPattcrnMa tch 
(BF.PatternMatch) 



MatchPattcras 
(BF.PatternMatch) 



MatchAPattern 
(BF.PatternMatch) 



Private ParseAndCleanPhrase 
Function 



Private ParseAndCleanPhrase 
Function 



Private ParseAndCleanPhrase 
Function 



Public GoBF 
Sub 



Public GaPatteraMatch 
Sub 



Private Ma tchPat terns 
Function 



MeetingField 
(BF.PatternMatch) 



BindNames 
(BF.PatternMatch) 



Private MatchAPattern 
Function 



Private MatchMeetingField 
Function 



Bind AFul INa me 
(BF.PatternMatch) 



Private BindNames 
Function 



GetNextWordAfterWhiteSpace Private BindAFullName, 
(BF.PatternMatch) Function BindUme, 

BindCo mp anyTopicLoc 



body and rejecting words without killing the whole function i guess 
keep Clean Word and check a return value ok, now i have a word so I 
need to send it down the parse chain. This chain goes 
ParseCleanPhrase -> CleanWord -> EvaluateWord. If the word gets 
through the entire chain without being killed, it will be added at the end 
to our keyword string, first would be the function that checks for "/" as 
a delimiter and extracts the parts of that This I will call "StitchFace" 
(Denise is more normal and calls it GetAwordFromString) if this finds 
words, then each of these will be sent, in turn, down the chain. If these 
get through the entire chain without being added or killed then they will 
be added rather than tossed. 

This function takes in 6 input values and evaluates to see what the 
minimum non zero value is. It first creates an array as a holder so that 
we can sort the five input values in ascending order. Thus the minimum 
value will be the first non zero value element of the array. If we go 
through entire array without rinding a non zero value, we know that 
that there is an error and we exit the function. 

This function tries to clean up a word in a meeting text. It first of all 
determines if the string is of a valid length. It then passes it through a 
series of tests to see it is clean and when needed, it will edit the word 
and strip unnecessary characters off of it. Such tests includes getting 
rid of file extensions, non chars, numbers etc. 
This function tests to see if this word is in the stop list so it can 
determine whether to eliininate the word from the original meeting text 
If a word is not in the stop list, it should stay around as a keyword and 
this function exits beautifully with no errors. However, if the words is a 
stop word, an error must be returned. We must properly delimit the input 
test string so we don't accidentally retrieve sub strings. 
This procedure is called when our QueryMethod is set to complex 
query meaning we do want to do all the pattern matching stuff. It's a 
simple wrapper function which initializes some airays and then invokes 
pattern matching on the title and the body. 

This procedure loops through every pattern in the pattern table and 
tries to identify different fields within a meeting text specified by 
slnEvalString. For debugging purposes it also tries to tabulate how 
many times a certain pattern was triggered and stores it in 
gTabulateMatches to see whichp pattern fired the most. 
gTabulateMatches is stored as a global because we want to be able to 
run a batch file of 40 or 50 test strings and still be able to know how 
often a pattern was triggered. 

This function goes through each element in the current pattern. It first 
evaluates to determine whether element is a Placeholder or an indicator. 
If it is a placeholder, then it will try to bind the placeholder with some 
value. If it is an indicator, then we try to locate it. There is a trick 
however. Depending on whether we are at current element is the head of 
the pattern or not we want to take different actions, [f we are at the 
head, we want to look for the indicator or the placeholder. If we can't 
fiad it, then we know that the current pattern doesn't exist and we quit 
However, if it is not the head, then we continue looking, because there 
may still be a head somewhere. We retry in this case. 
This function uses a big switch statement to first determine what kind 
of placeholder we are talking about and depending on what type of 
placeholder, we have specific requirements and different bmding criteria 
as specified in the subsequent functions called such as BindNames, 
BindTime etc. If binding is successful we add it to our guessing record. 
In this function, we try to match names to the corresponding 
placeholder $PEOPLE$. Names are defined as any consecutive two 
words which are capitalized. We also what to retrieve a series of names 
which are connected by and, or & so we look until we don't see any of 
these 3 separators anymore. Note that we don't want to bind single 
word 

names because it is probably too general anyway so we don't want to 
produce broad but irrelevant results. This function calls BindAFullName 
which binds one name so in a sence BindNames collects all the results 
from BindAFullName 

This function tries to bind a name. If the $PEOPLE$ placeholder is not 

the head of the pattern, we know that it has to come right at the 
beginning of the test string because we have been deleting information 
off of the head of the string all along. If it is the head, we search until 
we find something that looks like a full name. If we can't find it, then 
there's no such pattern in the text entirely and we quit entirely from this 
pattern. This should eventually return us to the next pattern in 
MatchPattcrns. 

This function grabs the next word in a test string. It looks for the next 
word after white spaces, @ or /. The word is defined to end when we 
encounter another one of these white spaces or separators. 
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-continued 



Procedure Name 



Type 



Called By 



Description 



BindTime 
(BF.PatternMatch) 



BindCompanyTopicLoc 
(BF.PatternMatch) 



LocatePatternHead 
(BEPatternMatch) 



ContainlnArray 
(BF.PatternMatch) 
Locatelndicator 
(BF.PatternMatch) 



InitializeGuessesRecord 
(BF.PatternMatch) 

AddToMeetingRecoid 
(BF.PatternMatch) 



NoDup licateEntry 
(BEPatternMatch) 

SearchAita Vista 
(BF.Seaich) 



ConstructAltaVistaURL 
(BFSearch) 



ConstructSiinp leKe y Wo r d 
(BF.Search) 



ConstructComplexAVKeyWord 
(BF.Seaich) 



Jo in With Connectors 
(BF.Search) 

RefineWithDate 
(NOT CALLED AT 
THE MOMENT) 
(BF.Search) 
RefineWithRank 
(BF.Search) 



Private 
Function 



Private 
Function 



Private 
Function 



Private 
Function 
Private 
Function 



Private 
Sub 



Private 
Sub 



IdentifyBlock 



Private 
Function 



Public 
Function 



Private 
Function 



Private 
Function 



Private 
Function 



Private 
Function 



Private 
Function 



Private 
Function 



Public 



MatchMcetingFicld 



Ma tchMeetingField 



MatchAPattem 



Loca tePa tternHead, 

Locatelndicator 

MatchAPattem 



MatchAPattem 



MatchAPattem 



AddToMeetingRecord 
GoBackGroundFinder 

SearchAita Vista 



ConstructAltaVistaURL, 
ConstructNewspageURL 



ConstructAltaVistaURL 



ConstructComplexAVKeyWord, 
ConstructComplexNPKcyWord, 
RefineWithRank 
ConstructAltaVistaURL 



ConstructAltaVistaURL 



SearchAita Vista, 



Get the immediate next word and see if it looks like a time pattern. 
If so we've found a time and so we want to add it to the record. 
We probably should add more time patterns. But people don't seem to 
like to enter the time in their titles these days especially since we now 
have tools like OutLook. 

This function finds a continuous capitalized string and binds it to 

stMatch which is passed by reference from MatchMeetingField. A 
conttnous capitalized string is a sequence of capitalized words which 
are not interrupted by things like, . etc. There's probably more stuff 
we can add to the list of interruptions. 

This function tries to locale an element which is an indicator. Note that 

this indicator SHOULD BE AT THE HEAD of the pattern otherwise it 
would have gone to the function Locatelndicator instead Therefore, 
we keep on grabbing the next word until either there's no word for us 
to grab (quit) or if we find one of the indicators we are looking for. 
This function is reallysimple. It loops through all the elements in the 
array 'to find a matching string. 

This function tries to locate an element which is an indicator. Note that 
this indicator is NOT at the head of the pattern otherwise it would have 
gone to LocatePatternHead instead. . Because of this, if our pattern is 
to be satisfied, the next word we grab HAS to be the indicator or else 
we would have failed. Thus we only grab one word, test to see if it is a 
valid indicator and then return result. 

This function reinitializes our temporary test structure because we 
have already transfered the info to the permanent structure, we can 
reinitialize it so they each have one element 

This function is only called when we know that the information stored 
in tlnCurrGucsscs is valid meaning that it represents legitimate 
guesses of meeting fields ready to be stored in the permanent record, 
tlnMectingRecord. We check to make sure that we do not store 
duplicates and we also what to clean up what we want to store so that 
there's no information such as punctuation, etc. The reason why we 
don't clean up until now is to save time. We don't waste resources 
calling ParseAndCleanPhrase until wc know for sure that we are 
going to add it permanently. 

This function loops through each element in the array to make sure 
that the test string aString is not the same as any of the strings already 
stored in the array. Slightly different from ContainlnArray. 
This function prepares a query to be submtted to AltaVista Search 
engine. It submits it and then parses the returning result in the 
appropriate format containing the title, URL and body/summary of each 
story retrieved. The number of stories retrieved is specified by the 
constant NUM_AV_STORIES. Important variables include 
stURLAlta Vista used to store query to submit stResultHTMLused to 
store html from page specified by stURLAlta Vista. 
This function constructs the URL string for the alta vista search engine 
using the advanced query search mode. It includes the keywords to be 
used, the language and how we want to rank the search. Depending on 
whether we want to use the results of our pattern matching unit, we 
construct our query differently. 

This function marches down the list of keywords stored in the 
stTitleKW or stBodyKW fields of the input meeting record and links 
them up into one string with each keyword separated by a connector as 
determined by the input variable stlnConnector. Returns this newly 
constructed string. 

This function constructs the keywords to be sent to the AltaVista site. 
Unlike ConstructSimpleKeyWord which simply takes all the keywords 
from the title to form the query, this function will look at the results of 
BF's pattern matching process and see if we are able to identify any 
specific company names or topics for constructing the queries. Query 
will include company and topic identified and default to simple query 
if we cannot identify either company or topic. 

This function simply replaces the spaces between the words within the 
string with a connector which is specified by the input. 

This function constructs the date portion of the alta vista query and 
returns this portion of the URL as a string. It makes sure that 
alta vista searches for articles within the past PAST_NDAYS. 

This function constructs the string needed to passed to Altavista in 
order to rank an advanced query search. If we are constructing the 
simple query we will take in all the keywords from the title. For the 
complex query, we will take in words from company and topic, much 
the same way we formed the query in ConstructComplexAVKeyWord. 
This function extracts the block within a string marked by the beginning 
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-continued 



Procedure Name 



Type 



Called By 



Description 



(BF.Parsc) 



IsOpenURLEnor 
(BF.Error) 

SearchNewsPage 
(BF.Search) 



ConstructNewsPagetURL 
(BF.Search) 



Function SeaichNewsPage 



Public SearchAlta Vista, 

Function SeaichNewsPage 

Public GoBackGroundFinder 
Function 



Private SeaichNewsPage 
Function 



ConstiuctComplexNPKeyWord Private ConstructNewsPageURL 
(BF.Search) Function 



ConstructOverall Result 
(BF.Main) 



Private GoBackGroundFinder 
Function 



ConncctAndTransfeiToMunin Public GoBackGroundFinder 
(BF.Main) Sub 



Disco nneclFromMuninAnd Public 
Quit Sub 
(BF.Main) 



and the ending tag given as inputs starting at a certain lo cation (iS tart). 
The block retrieved does not include the tags themselves. If the block 
cannot be identified with the specified delimiters, we return 
unsuccessful through the parameter iReturnSuccess passed to use 
by reference. The return type is the block retrieved. 
This function determines whether the error encountered is that of a 
timeout error. It restores the mouse to default arrow and ttien returns 
true if it is a time out or false otherwise. 

This function prepares a query to be submitted to NewsPage Search 
engine. It submits it and then parses the returning result in the 
appropriate format containing the title, URL and body/summary of each 
story retrieved. The number of stories retrieved is specified by the 
constant UM_NP_STORWS 

This function constructs the URL to send to the NewsPage site. 
It uses the information contained in the input meeting lecord to 
determine what keywords to use. Also depending whether we want 
simple or complex query, we call diffent functions to foim strings. 
This function constructs the keywords to be send to the NewsPage site. 
UnlikeConstructKeywordString which simply takes the keywords 
from the title to form the query, this function will look at the results of 
BFs pattern matching process and see if we are able to identify any 
specific company names or topics for constructing the queries. Since 
newspage works best when we have a company name, we'll use only 
the company name and only if there is no company will we use topic. 
This function takes in as input an array of strings (stlnStories) and a 
MeetingRecord which stores the information for the current meeting. 
Each element in the array stores the stories retrieved from each 
information source. The function simply constructs the appropriate 
output to send to Munin including a return message type to let Munin 
know that it is the BF responding and also the original user__id and 
meeting title so Munin knows which meeting BF is talking about. 
This function allows Background Finder to connect to Munin and 
eventually transport information to Munin. We will be using the UDP 
protocol instead of the TCP protocol so we have to set up the remote 
host and port coriectly. We use a global string to store gResult Overall 
because although it is uneccssary with UDP, it is needed with TCP and 
if we ever switch back don't want to chaage code. 



FIG. 6 is a flowchart of the actual code utilized to prepare 
and submit searches to the Alta Vista and Newspage search 
engines in accordance with a preferred embodiment. Pro- 
cessing commences at function block 610 where a command 
line is utilized to update a calendar entry with specific 
calendar information. The message is next posted in accor- 
dance with function block 620 and a meeting record is 
created to store the current meeting information in accor- 
dance with function block 630. Then, in function block 640 
the query is submitted to the Alta Vista search engine and in 
function block 650, the query is submitted to the Newspage 
search engine. When a message is returned from the search 
engine, it is stored in a results data structure as shown in 
function block 660 and the information is processed and 
stored in summary form in a file for use in preparation for 
the meeting as detailed in function block 670. 

FIG. 7 provides more detail on creating the query in 
accordance with a preferred embodiment. Processing com- 
mences at function block 710 where the meeting record is 
parsed to obtain potential companies, people, topics, loca- 
tion and a time. Then, in function block 720, at least one 
topic is identified and in function block 720, at least one 
company name is identified and finally in function block 
740, a decision is made on what material to transmit to the 
file for ultimate consumption by the user. 

FIG. 8 is a variation on the query theme presented in FIG. 
7. A meeting record is parsed in function block 800, a 
company is identified in function block 820, a topic is 



identified in function block 830 and finally in function block 
840 the topic and or the company is utilized in formulating 
the query. 

Alternative embodiments for adding various specific fea- 
tures for specific user requirements are discussed below. 

Enhance Target Rate for Pattern Matching 

To increase BFs performance, more patterns/pattern 
groups are added to the procedure "CreatePatterns." The 
existing code for declaring patterns can be used as a template 
for future patterns. Because everything is stored as dynamic 
arrays, it is convenient to reuse code by cutting and pasting. 
The functions BindName, BindTime, BindCompanyLoc- 
Topic which are responsible for associating a value with a 
placeholder can be enhanced. The enhancement is realized 
by increasing the set of criteria for binding a certain meeting 
field in order to increase the number of binding values. For 
example, BindTime currently accepts and binds all values in 
the form of ##:## or #:##. To increase the times we can bind, 
we may want BindTime to also accept the numbers 1 to 12 
followed by the more aesthetic time terminology "o'clock." 
Vocabulary based recognition algorithms and assigning an 
accuracy rate to each guess BF makes allowing only guesses 
which meet a certain threshold to be valid- 
Depending on what location the system identifies through 
pattern matching or alternatively depending on what loca- 
tion the user indicates as the meeting place, a system in 
accordance with a preferred embodiment suggests a plurality 
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of fine restaurants whenever it detects the words lunch/ mySite! Personal Web Site & Intentions Value 
dinner/breakfast. We can also use a site like company finder Network Prototype 
to confirm what we got is indeed a company name or if there , . .. , . T , j 
is no company name that pattern matching can identify, we m y Slte! 15 a high-impact, Internet-based application in 
can use a company finder web site as a "dictionary" for us 5 accordance with a preferred embodiment that is focused on 
to determine whether certain capitalized words represent a foe theme of delivering services and providing a personal- 
company name. We can even display stock prices and ized experience for each customer via a personal web site in 
breaking news for a company that we have identified. a buyer-centric world. The services are intuitively organized 

„ T . , n . T1 . . A , „ Til around satisfying customer intentions — fundamental life 

Wireless Bargain Identification in Accordance With _ _ Jr- e (U 4 „i ont ,: n „ 

a n c j ^ i_ j- i. needs or objectives that require extensive planning 

A Preferred Embodiment 10 , . . , t . , j. . f 

decisions, and coordination across several dimensions, such 

FIG. 9 is a flow diagram that depicts the hardware and as financial planning, healthcare, personal and professional 

logical flow of control for a device and a software system development, family life, and other concerns. Each member 

designed to allow Web-based comparison shopping in owns and mamtams his own profile, enabling him to create 

conventional, physical non-Web retail environments^ A ^ brQWSe m ^ tem t d ificall at 

wireless phone or similar hand-held wireless device 920 is him FrQm ^ ^ demand for ^ of . 

with Internet Protocol capability is combined with a mima- , . , . . c , 

* j , nm/ *n j u ■ j *i_ i. entered, to the completion of payment, intelligent agents are 
rure barcode reader 910 (installed either inside the phone or ■ _, , , , . j 
on a short cable) and used to scan the Universal Product ut * zt * to conduct research, execute transactions and pro- 
Code (UPC) bar code on a book or other product 900. Hie vide advice. By using advanced profiling and filtering, the 
wireless device 920 transmits the bar code via an antennae 20 intelligent agents learn about the user, improving the ser- 
930 to the Pocket BargainFinder Service Module (running vlces mev deliver. Customer intentions include Managing 
on a Web server) 940, which converts it to (in the case of Daily Logistics (e.g., email, calendar, contacts, to-do list, 
books) its International Standard Book Number or (in the biU payment, shopping, and travel planning); and Moving to 
case of other products) whatever identifier is appropriate. a New Community (e.g., finding a place to live, moving 
The Service Module then contacts the appropriate third- 25 household possessions, getting travel and shipping insurance 
party Web site(s) to find price, shipping and availability coverage, notifying business and personal contacts, learning 
information on the product from various Web suppliers 950. about the new community). From a consumer standpoint, 
This information is formatted and displayed on the hand- mySite! provides a central location where a user can access 
held device's screen. The IP wireless phone or other hand relevant products and services and accomplish daily tasks 
held device 920 utilizes a wireless modem such as a Rico- 30 with ultimate ease and convenience, 
chet SE Wireless Modem from Metricom. Utilizing this From a business standpoint, mySite! represents a value- 
device, a user can hang out in a coffee shop with a portable added and innovative way to effectively attract, service, and 
computer perched on a rickety little table, with a latte retain customers. Intention value networks allow a user to 
sloshing dangerously close to the keyboard, and access the enter through a personalized site and, and with the assistance 
Internet at speeds rivaling direct connect via a telephone 35 of a learning, intelligent agent, seamlessly interact with 
line. network participants. An intention value network in accor- 

The 8-ounce Ricochet SE Wireless Modem is about as dance with a preferred embodiment provides superior value, 

large as a pack of cigarettes and setup is extremely simple, It provides twenty four hour a day, seven days a week access 

simply attach the modem to the back of your portable's to customized information, advice and products. The infor- 

screen with the included piece of Velcro, plug the cable into 40 mation is personalized so that each member views content 

the serial port, flip up the stubby antenna, and transmit. that is highly customized to assure relevance to the required 

Software setup is equally easy: a straightforward installer target user, 

adds the Ricochet modem drivers and places the connection . 

icon on your desktop. The functional aspects of the modem Egocentnc Interface 

are identical to that of a traditional telephone modem. 45 An Egocentric Interface is a user interface crafted to 

Of course, wireless performance isn't nearly as reliable as satisfy a particular user's needs, preferences and current 
a traditional dial-up phone connection. We were able to get context. It utilizes the user's personal information that is 
strong connections in several San Francisco locations as stored in a central profile database to customize the inter- 
long as we stayed near the windows. But inside CNET's face. The user can set security permissions on and prefer- 
all-brick headquarters, the Ricochet couldn't connect at all. 50 ences for interface elements and content. The content inte- 
When you do get online, performance of up to 28.8 kbps is grated, into the Egocentric Interface is customized with 
available with graceful degradation to slower speeds. But related information about the user. When displaying content, 
even the slower speeds didn't disappoint. Compared to the the Egocentric Interface will include the relationship 
alternative — connecting via a cellular modem — the Rico- between that content and the user in a way that demonstrates 
chet is much faster, more reliable, and less expensive to use. 55 how the content relates to the user. For instance, when 
Naturally, the SE Wireless is battery powered. The modem displaying information about an upcoming ski trip the user 
has continuous battery life of up to 12 hours. And in has signed up for, the interface will include information 
accordance with a preferred embodiment, we ran down our about events from the user's personal calendar and contact 
portable computer's dual cells before the Ricochet started to list, such as other people who will be in the area during the 
fade. 60 ski trip. This serves to put the new piece of information into 

Thus, utilizing the wireless modem, a user may utilize the a context familiar to the individual user, 

web server software 940 to identify the right product 950 FIG. 10A describes the Intention Value Network Archi- 

and then use an appropriate device's key(s) to select a tecture implementation for the World Wide Web. For sim- 

supplier and place an order in accordance with a preferred plification purposes, this diagram ignores the complexity 

embodiment. The BargainFinder Service Module then con- 65 pertaining to security, scalability and privacy. The customer 

summates the order with the appropriate third -party Web can access the Intention Value Network with any Internet 

supplier 960, web browser 1010, such as Netscape Navigator or Microsoft 
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Internet Explorer, running on a personal computer connected 
to the Internet or a Personal Digital Assistant with wireless 
capability. See FIG. 17 for a more detailed description of the 
multiple methods for accessing an Intention Value Network. 
The customer accesses the Intention Value Network through 5 
the unique name or IP address associated with the Integra- 
tor's Web Server 1020. The Integrator creates the Intention 
Value Network using a combination of resources, such as the 
Intention Database 1030, the Content Database 1040, the 
Supplier Profile Database 1050, and the Customer Profile 
Database 1060. 

The Intention Database 1030 stores all of the information 
about the structure of the intention and the types of products 
and services needed to fulfill the intention. Information in 
this database includes intention steps, areas of interest, 15 
layout templates and personalization templates. The Content 
Database 1040 stores all of the information related to the 
intention, such as advice, referral information, personalized 
content, satisfaction ratings, product ratings and progress 
reports. 20 

The Supplier Profile Database 1050 contains information 
about the product and service providers integrated into the 
intention. The information contained in this database pro- 
vides a link between the intention framework and the 
suppliers. It includes product lists, features and descriptions, 2 5 
and addresses of the suppliers' product web sites. The 
Customer Profile Database 1060 contains personal informa- 
tion about the customers, such as name, address, social 
security number and credit card information, personal 
preferences, behavioral information, history, and web site 30 
layout preferences. The Supplier's Web Server 1070 pro- 
vides access to all of the supplier's databases necessary to 
provide information and transactional support to the cus- 
tomer. 

The Product Information Database 1080 stores all 35 
product-related information, such as features, availability 
and pricing. The Product Order Database 1090 stores all 
customer orders. The interface to this database may be 
through an Enterprise Resource Planning application offered 
by SAP, Baan, Oracle or others, or it may be accessible 40 
directly through the Supplier's Web Server or application 
server. The Customer Information Database 1091 stores all 
of the customer information that the supplier needs to 
complete a transaction or maintain customer records. 

FTC 10B is a flowchart providing the logic utilized to 45 
create a web page within the Egocentric Interface. The 
environment assumes a web server and a web browser 
connected through a TCP/IP network, such as over the 
public Internet or a private Intranet. Possible web servers 
could include Microsoft Internet Information Server, 50 
Netscape Enterprise Server or Apache. Possible web brows- 
ers include Microsoft Internet Explorer or Netscape Navi- 
gator. The client (i.e. web browser) makes a request 1001 to 
the server (i.e. web server) for a particular web page. This is 
usually accomplished by a user clicking on a button or a link 55 
within a web page. The web server gets the layout and 
content preferences 1002 for that particular user, with the 
request to the database keyed off of a unique user id stored 
in the client (i.e. web browser) and the User profile database 
1003. The web server then retrieves the content 1004 for the 60 
page that has been requested from the content database 

1005. The relevant user-centric content, such as calendar, 
email, contact list, and task list items are then retrieved 

1006. (See FIG. 11 for a more detailed description of this 
process.) The query to the database utilizes the user content 65 
preferences stored as part of the user profile in the User 
profile database 1003 to filter the content that is returned. 



The content that is returned is then formatted into a web 
page 1007 according to the layout preferences defined in the 
user profile. The web page is then returned to the client and 
displayed to the user 1008. , 
FIG. 11 describes the process of retrieving user-centric 
content to add to a web page. This process describes 1006 in 
FIG. 10B in a more detailed fashion. It assumes that the 
server already has obtained the user profile and the existing 
content that is going to be integrated into this page. The 
server parses 1110 the filtered content, looking for instances 
of events, contact names and email addresses. If any of these 
are found, they are tagged and stored in a temporary holding 
space. Then, the server tries to find any user-centric content 
1120 stored in various databases. This involves matching the 
tagged items in the temporary storage space with calendar 
items 1130 in the Calendar Database 1140; email items 1115 
in the Email Database 1114; contact items 1117 in the 
Contact Database 1168; task list items 1119 in the Task List 
Database 1118; and news items 1121 in the News Database 
1120. After retrieving any relevant user-centric content, it is 
compiled together and returned 1122. 

User Persona 

The system allows the user to create a number of different 
personas that aggregate profile information into sets that are 
useful in different contexts. A user may create one persona 
when making purchases for his home. This persona may 
contain his home address and may indicate that this user is 
looking to find a good bargain when shopping. The same 
user may create a second persona that can be used when he 
is in a work context. This persona may store the user's work 
address and may indicate that the user prefers certain ven- 
dors or works for a certain company that has a discount 
program in place. When shopping for work-related items, 
the user may use this persona. A persona- may also contain 
rules and restrictions. For instance, the work persona may 
restrict the user to making airline reservations with only one 
travel agent and utilizing booking rules set up by his 
employer. 

FIG. 12 describes the relationship between a user, his 
multiple personas and his multiple profiles. At the User 
Level is the User Profile 1200. This profile describes the user 
and his account information. There is one unique record in 
the database for each user who has an account. Attached to 
each user are multiple Personas 1220, 1230 & 1240. These 
Personas are used to group multiple Profiles into useful 
contexts. For instance, consider a user who lives in San 
Francisco and works in Palo Alto, but has a mountain cabin 
in Lake Tahoe. He has three different contexts in which he 
might be accessing his site. One context is work-related. The 
other two are home-life related, but in different locations. 
The user can create a Persona for Work 1220, a Persona for 
Home 1230, and a Persona for his cabin home 1240. Each 
Persona references a different General Profile. 1250, 1260 
and 1270 which contains the address for that location. 
Hence, there are three General Profiles. Each Persona also 
references one of two Travel Profiles. The user maintains a 
Work Travel Profile 1280 that contains all of the business 
rules related to booking tickets and making reservations. 
This Profile may specify, for instance, that this person only 
travels in Business or First Class and his preferred airline is 
United Airlines, The Work Persona references this Work 
Travel Profile. The user may also maintain a Home Travel 
Profile 1290 that specifies that he prefers to travel in coach 
and wants to find non-refundable fairs, since they are 
generally cheaper. Both the Persona for Home and the 
Persona for the cabin home point to the Home Travel Profile. 
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FIG. 13 describes the data model that supports the Per- 
sona concept. The user table 1310 contains a record for each 
user who has an account in the system. This table contains 
a username and a password 1320 as well as a unique 
identifier. Each user can have multiple Personas 1330, which 5 
act as containers for more specialized structures called 
Profiles 1340. Profiles contain the detailed personal infor- 
mation in Profile Field 1350 records. Attached to each 
Profile are sets of Profile Restriction 1360 records. These 
each contain a Name 1370 and a Rule 1380, which define the 
restriction. The Rule is in the form of a pattern like (if x then 
y), which allows the Rule to be restricted to certain uses. An 
example Profile Restriction would be the rule that dictates 
that the user cannot book a flight on a certain airline 
contained in the list. This Profile Restriction could be 
contained in the "Travel" Profile of the "Work" Persona set 15 
up by the user's employer, for instance. Each Profile Field 
also contains a set of Permissions 1390 that are contained in 
that record. These permissions dictate who has what access 
rights to that particular Profile Field's information. 

20 

Intention-Centric Interface 

Satisfying Customer Intentions, such as Planning for 
Retirement or Relocating requires a specialized interface. 
Customer Intentions require extensive planning and coordi- 
nation across many areas, ranging from financial security, 25 
housing and transportation to healthcare, personal and pro- 
fessional development, and entertainment, among others. 
Satisfying Intentions requires a network of complementary 
businesses, working across industries, to help meet consum- 
ers' needs. 

An Intention- Centric Interface is a user interface designed 30 
to help the user manage personal Intentions. At any given 
point, the interface content is customized to show only 
content that relates to that particular Intention. The 
Intention- Centric Interface allows the user to manage the 
process of satisfying that particular Intention. This involves 35 
a series of discrete steps and a set of content areas the user 
can access. At any point, the user can also switch the 
interface to manage a different Intention, and this act will 
change the content of the interface to include only that 
content which is relevant to the satisfaction of the newly 40 
selected Intention. 

FIG. 14 provides a detailed description of the data model 
needed to support an Intention-Centric Interface. Each User 
Persona 1410 (see FIG. 13 for a more detailed description of 
the Persona data model.) has any number of active User 45 
Intentions 1420. Each active User Intention is given a 
Nickname 1430, which is the display name the user sees on 
the screen. Each active User Intention also contains a 
number of Data Fields 1440, which contain any user data 
collected throughout the interaction with the user. For 
instance, if the user had filled out a form on the screen and 
one of the fields was Social Security Number, the corre- 
sponding Data Field would contain Name^'SSN" 1450, 
Value="999-99-9999" 1460. Each User Intention also keeps 
track of Intention Step 1470 completion status. The Comple- 
tion 1480 field indicates whether the user has completed the 55 
step. Every User Intention is a user-specific version of a 
Generic Intention 1490, which is the default model for that 
Intention for all users. The Generic Intention is customized 
through Custom Rules 1411 and 1412 that are attached to the 
sub-steps in the Intention. These Custom Rules are patterns 60 
describing how the system will customize the Intention for 
each individual user using the individual user's profile 
information. 

Statistical Agent 65 

An agent keeps track of key statistics for each user. These 
statistics are used in a manner similar to the Tamagochi 
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virtual reality pet toy to encourage certain behaviors from 
the user. The statistics that are recorded are frequency of 
login, frequency of rating of content such as news articles, 
and activity of agents, measured by the number of tasks 
which it performs in a certain period. This information is 
used by the system to emotionally appeal to the user to 
encourage certain behaviors. 

FIG. 15 describes the process for generating the page that 
displays the agent's current statistics. When the user 
requests the agent statistics page 1510 with the client 
browser, the server retrieves the users' statistics 1520 from 
the users' profile database 1530. The server then performs 
the mathematical calculations necessary to create a normal- 
ized set of statistics 1540. The server then retrieves the 
formulas 1550 from the content database 1560 that will be 
used to calculate the user-centric statistics. Graphs are then 
generated 1570 using the generic formulas and that user's 
statistics. These graphs are inserted into a template to create 
the statistics page 1580. This page is then returned to the 
user 1590. 

Personalized Product Report Service 

The system provide Consumer Report-like service that is 
customized for each user based on a user profile. The system 
records and provides ratings from users about product 
quality and desirability on a number of dimensions. The 
difference between this system and traditional product qual- 
ity measurement services is that the ratings that come back 
to the users are personalized. This service works by finding 
the people who have the closest match to the user's profile 
and have previously rated the product being asked for. Using 
this algorithm will help to ensure that the product reports 
sent back to the user only contain statistics from people who 
are similar to that user. 

FIG. 16 describes the algorithm for determining the 
personalized product ratings for a user. When the user 
requests a product report 1610 for product X, the algorithm 
retrieves the profiles 1620 from the profile database 1630 
(which includes product ratings) of those users who have 
previously rated that product. Then the system retrieves the 
default thresholds 1640 for the profile matching algorithm 
from the content database 1650. It then maps all of the short 
list of users along several dimensions specified in the profile 
matching algorithm 1660. The top n (specified previously as 
a threshold variable) nearest neighbors are then determined 
and a test is performed to decide if they are within distance 
y (also specified previously as a threshold variable) of the 
user's profile in the set 1670 using the results from the 
profile matching algorithm. If they are not within the 
threshold, then the threshold variables are relaxed 1680, and 
the test is run again. This processing is repeated until the test 
returns true. The product ratings from the smaller set of n 
nearest neighbors are then used to determine a number of 
product statistics 1690 along several dimensions. Those 
statistics are inserted into a product report template 1695 and 
returned to the user 1697 as a product report. 

Personal Profile and Services Ubiquity 

This system provides one central storage place for a 
person's profile. This storage place is a server available 
through the public Internet, accessible by any device that is 
connected to the Internet and has appropriate access. 
Because of the ubiquitous accessibility of the profile, numer- 
ous access devices can be used to customize services for the 
user based on his profile. For example, a merchant's web site 
can use this profile to provide personalized content to the 
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user. A Personal Digital Assistant (PDA) with Internet 
access can synchronize the person's calendar, email, contact 
list, task list and notes on the PDA with the version stored 
in the Internet site. This enables the person to only have to 
maintain one version of this data in order to have it available 
whenever it is needed and in whatever formats it is needed. 

FIG. 17 presents the detailed logic associated with the 
many different methods for accessing this centrally stored 
profile. The profile database 1710 is the central storage place 
for the users' profile information. The profile gateway server 
1720 receives all requests for profile information, whether 
from the user himself or merchants trying to provide a 
service to the user. The profile gateway server is responsible 
for ensuring that information is only given out when the 
profile owner specifically grants permission. Any device that 
can access the public Internet 1730 over TCP/IP (a standard 
network communications protocol) is able to request infor- 
mation from the profile database via intelligent HTTP 
requests. Consumers will be able to gain access to services 
from devices such as their televisions 1740, mobile phones, 
Smart Cards, gas meters, water meters, kitchen appliances, 
security systems, desktop computers, laptops, pocket 
organizers, PDAs, and their vehicles, among others. 
Likewise, merchants 1750 will be able to access those 
profiles (given permission from the consumer who owns 
each profile), and will be able to offer customized, person- 
alized services to consumers because of this. 

One possible use of the ubiquitous profile is for a hotel 
chain. A consumer can carry a Smart Card that holds a digital 
certificate uniquely identifying him. This Smart Card's 
digital certificate has been issued by the system and it 
recorded his profile information into the profile database. 
The consumer brings this card into a hotel chain and checks 
in. The hotel employee swipes the Smart Card and the 
consumer enters his Pin number, unlocking the digital 
certificate. The certificate is sent to the profile gateway 
server (using a secure transmission protocol) and is authen- 
ticated. The hotel is then given access to a certain part of the 
consumer's profile that he has previously specified. The 
hotel can then retrieve all of the consumer's billing infor- 
mation as well as preferences for hotel room, etc. The hotel 
can also access the consumer's movie and dining prefer- 
ences and offer customized menus for both of them. The 
hotel can offer to send an email to the consumer's spouse 
letting him/her know the person checked into the hotel and 
is safe. All transaction information can be uploaded to the 
consumer's profile after the hotel checks him in. This will 
allow partners of the hotel to utilize the information about 
the consumer that the hotel has gathered (again, given the 
consumer's permission). 

Intention Value Network 

In an Intention Value Network, the overall integrator 
system coordinates the delivery of products and services for 
a user. The integrator manages a network of approved 
suppliers providing products and services, both physical and 
virtual, to a user based on the user's preferences as reflected 
in the user's profile. The integrator manages the relationship 
between suppliers and consumers and coordinates the sup- 
pliers' fulfillment of consumers' intentions. It does this by 
providing the consumer with information about products and 
suppliers and offering objective advice, among other things. 

FIG. 18 discloses the detailed interaction between a 
consumer and the integrator involving one supplier. The user 
accesses a Web Browser 1810 and requests product and 
pricing information from the integrator. The request is sent 
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from the user's browser to the integrator's Web/Application 
Server 1820. The user's preferences and personal informa- 
tion is obtained from an integrator's customer profile data- 
base 1830 and returned to the Web/Application server. The 

5 requested product information is extracted from the suppli- 
er's product database 1840 and customized for the particular 
customer. The Web/Application server updates the suppli- 
er's customer information database 1850 with the inquiry 
information about the customer. The product and pricing 

10 information is then formatted into a Web Page 1860 and 
returned to the customer's Web Browser. 

Summary Agent 

is A suite of software agents running on the application and 
web servers are programmed to take care of repetitive or 
mundane tasks for the user. The agents work according to 
rules set up by the user and are only allowed to perform tasks 
explicitly defined by the user. The agents can take care of 
paying bills for the user, filtering content and emails, and 
providing a summary view of tasks and agent activity. The 
user interface for the agent can be modified to suit the 
particular user. 

FIG. 19 discloses the logic in accordance with a preferred 

25 embodiment processing by an agent to generate a verbal 
summary for the user. When the user requests the summary 
page 1900, the server gets the user's agent preferences 1920, 
such as agent type, rules and summary level from the user 
profile database 1930. The server gets the content 1940, such 

30 as emails, to do list items, news, and bills, from the content 
database 1950. The agent parses all of this content, using the 
rules stored in the profile database, and summarizes the 
content 1960. The content is formatted into a web page 1970 
according to a template. The text for the agent's speech is 

35 generated 1980, using the content from the content database 
1990 and speech templates stored in the database. This 
speech text is inserted into the web page 1995 and the page 
is returned to the user 1997. 

40 Trusted Third Party 

The above scenario requires the web site to maintain a 
guarantee of privacy of information according to a published 
policy. This system is the consumer's Trusted Third Party, 
acting on his behalf in every case, erring on the side of 
45 privacy of information, rather than on the side of stimulation 
of commerce opportunities. The Trusted Third Party has a 
set of processes in place that guarantee certain complicity 
with the stated policy, 

50 "meCommerce" 

This word extends the word "eCommerce" to mean 
"personalized electronic commerce." 

FIG. 20 illustrates a display login in accordance with a 

55 preferred embodiment. The display is implemented as a 
Microsoft Internet Explorer application with an agent 2000 
that guides a user through the process of interacting with the 
system to customize and personalize various system com- 
ponents to gather information and interact with the user's 

60 personal requirements. A user enters a username at 2010 and 
a password at 2020 and selects a button 2040 to initiate the 
login procedure. As the logo 2030 suggests, the system 
transforms electronic commerce into a personalized, so 
called "me" commerce. 

65 FIG. 21 illustrates a managing daily logistics display in 
accordance with a preferred embodiment, A user is greeted 
by an animated agent 2100 with a personalized message 
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2190. The user can select from various activities based on of information such that the quantity of information would 

requirements, including travel 2110, household chores 2120, be lessened. Rather than simply removing random bits of 

finances 2130 and marketplace activities 2140. Icons 2142 information, however, most of these approaches tried to be 

for routine tasks such as e-mail, calendaring and document intelligent about what information was ultimately presented 

preparation are also provided to facilitate rapid navigation 5 to the user. This was accomplished by evaluating each 

from one activity to another. Direct links 2146 are also document based on the user's interests and discarding the 

provided to allow transfer of news and other items of less relevant ones. It follows, therefore, that the quality was 

interest. Various profiles can be selected based on where the also increased. 

user is located. For example, work, home or vacation. The Filtering the information is only a first step in dealing with 

profiles can be added 2170 as a user requires a new profile 10 & Ms new age> Arguably, just as important as 

for another location. Various items 2180 of personal infor- the quality of the document ^ having ready access to it. 

mation are collected from the user to support various 0ncc you have entered a meeting, a document containing 

endeavors. Moreover, permissions 2150 are set for items critical mformation about the meeting subject delivered to 

2180 to assure information is timely and current. yQur office fc of Kule yalue> M the speed of business 

FIG. 22 illustrates a user main display in accordance with 15 con tinues to increase fueled by the technologies of 

a preferred embodiment. World 2200 and local news 2210 is interconnectedness, the ability to receive quality information 

provided based on a user's preference. The user has also wherever and whenever you are becomes critical. This new 

selected real estate 2230 as an item to provide direct approach is called intelligent information delivery and is 

information on the main display. Also, a different agent 2220 heralding in a new information age. 

is provided based on the user's preference. 20 A - , , , A . . . , , 

r r A preferred embodiment demonstrates the intelligent 

FIG. 23 illustrates an agent interaction in accordance with information delivery theory described above in an attempt to 

a preferred embodiment. The agent 2310 is communicating nQt only reduce information ove rload, but to deliver high 

information 2300 to a user indicating that the user's life qiiality ^formation where and when users'require it. In 

insurance needs have changed and pointing the user to the other words ^ the system delivers right information to the 

chart that best summarizes the information for the user. dght person at the right time and ^ right pkce 

Particular tips 2395 are provided to facilitate more detailed Actiye Management System Description 

information based on current user statistics. A chart 2370 of piG u fc a bk)ck m of &n ^ knowled 

the user s life insurance needs is also highlighted at the . °, c , u ?. 

- A . ,. . , • . , L • j 4 * • management system m accordance with a preferred embodi- 

center of the display to assist the user in determining , : ■ * * *i_ r ™ • -* u t a 

. » . m . ,. on . j a £ a 3 o ment. The system consists of the following parts: back-end 

appropriate action. A button 2380 is provided to facilitate JU ~ AfXfx *\. " i u-i 

t . ^ , A ^ >v*Aft -j j 2400 connection to one or more servers, personal mobile 

changing the policy and a set of buttons 2390 are provided clien|s (Awareness Machine) 2430 243<i blic 

to assist a user in selecting various views of the user s c]ien{s ^ ^ ^ 2m 

insurance requirements. e . fflail ^ 

Event Backgrounder 35 Back-end Server (2400) Processes 
An Event Backgrounder is a short description of an FIG. 25 is a block diagram of a back end server in 
upcoming event that is sent to the user just before an event. accordance with a preferred embodiment. The back-end 
The Event Backgrounder is constantly updated with the (2400 of FIG. 24) is a computer system that has the 
latest information related to this event. Pertinent information following software active: Intelligent Agents Coordinator 
such as itinerary and logistics are included, and other useful 40 (Munin) 2580, Information Prioritization Subsystem 2530, a 
information, such as people the user knows who might be in set of continuously and periodically running information 
the same location, are also included. The purpose of the gathering and processing Intelligent Agents 2500, 2502 and 
Event Backgrounder is to provide the most up-to-date infor- 2504, User Profiles Database 2542 and supporting software, 
mation about an event, drawing from a number of resources, Information Channels Database 2542 and supporting 
such as public web sites and the user's calendar and contact 45 software, communications software 2550, information trans- 
lists, to allow the user to react optimally in a given situation. formation software 2560, and auxiliary software. 

The Awareness Machine (2446 & 2448 of FIG. 24) 

Vicinity Friend Finder Thc Awareness Machine is a combination of hardware 

This software looks for opportunities to tell the user when device and software application. The hardware consists of 

a friend, family member or acquaintance is or is going to be 50 handheld personal computer and wireless communications 

in the same vicinity as the user. This software scans the device. The Awareness Machine reflects a constantly 

user's calendar for upcoming events. It then uses a geo- updated state-of -the -owner's-wo rid by continually receiving 

graphic map to compare those calendar events with the a wireless trickle of information. This information, mined 

calendar events of people who are listed in his contact list. and processed by a suite of intelligent agents, consists of 

It then informs the user of any matches, thus telling the user 55 ma ji messages, news that meets each user's preferences, 

that someone is scheduled to be near him at a particular time. schedule updates, background information on upcoming 

Information Overload meetin S s and events >. as weU J* J* 6 

Awareness Machine is covered by another patent applica- 

The term information overload is now relatively under- t fo n . 

stood in both its definition as well as its implications and 6 0 FK> 2 6 is a block diagram of a magic wall in accordance 

consequences. People have a finite amount of attention that with a ferred embodiment, 

is available at any one time, but there is more and more ^ e ^ 

vying for that attention every day. In short, too much _ , = . T „ T „ , . • , j 

• c 4 - 1 t . c 4 The Magic Wall hardware includes: 

information and too little time are the primary factors 6 

complicating the lives of most knowledge workers today. 65 Computer system 2640 connected to the back-end server 

The first attempts to dynamically deal with information Sensor array 2634, 2630 and 2632 detects presence, 

overload were primarily focused on the intelligent filtering position, and identity of a person 
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Large touch-sensitive display 2620 
Sound input 2610/output 2614 hardware 
The Magic Wall software supports: 
Multimedia output compatible with current Web stan- 
dards 5 
Speech recognition 
Tactile input 

Intelligent agents representations in the form of speech- 
enabled animated characters 10 
The Magic Wall operates as follows: 

1. If a user appears in the vicinity of Magic Wall, the 
sensor array triggers "user here" event that sends an 
environmental cue containing the person's id and the 
location to the Intelligent Agent Coordinator. 15 

2. User is identified based on the information returned by 
the sensor array. 

3. The Magic Wall switches to "locked on the user" mode. 
If another user approaches, the system will notify him 

or her that it cannot serve another user while the current 20 
user is being served. 

4. Intelligent Agent Coordinator is notified about the user 
presence. 

5. The Intelligent Agent Coordinator decides if there is 
pertinent to that user and Magic Wall location time- 25 
sensitive information to show (e.g. traffic report, meet- 
ing reminder). If such information exists, it is prepared 
for delivery. If not, control is transferred to the Infor- 
mation Prioritization Subsystem. 

6. Information Prioritization Subsystem decides what 30 
information is most relevant to the user based on their 
personal profile, freshness of the information, and the 
Intelligent Agent Coordinator's prior suggestions. 

7. The page of information identified as the most relevant 
to the user at this time and place is shown. The act of 
the information delivery can also include animation and 
speech output of the intelligent agent representation. 

8. If user desires so, he or she can ask Magic Wall to show 
a particular page. The Magic Wall recognizes the 
speech fragment and then identifies and shows the 
requested page. 

9. As the user departs from the Magic Wall area, the 
sensor array triggers "user left" event. 

10. The Magic Wall switches back to the waiting state. 45 
Other Clients 

The Web client is a standard browser navigating to a set 
of Web pages which allow user to see the same information 
that is available via the Magic Wall. 

The e-mail client is any standard e-mail program. 5Q 
Intelligent Agent Coordinator Description 

This piece of code is the coordinating agent (or meta- 
agent) for the Active Knowledge Management system. This 
means that all communications between the system and each 
user, as well as communication between the different minion 55 
agents are handled (coordinated) by the Intelligent Agent 
Coordinator. Examples of these minion agents are: 

BackgroundFinder — an agent that parses meeting text 
determining important keywords and phrases and finds 
background information on the meeting for each user 60 
TrafficFinder — an agent that finds traffic information for 

each user based on where they live 
Several other agents that are responsible for doing statis- 
tical analysis of the data in each user's profile and 
updating fields pertinent to that data 65 
The Intelligent Agent Coordinator 2580 of FIG. 25 is also 
the user's "interface" to the system, in that whenever the 



35 



user interacts with the system, regardless of the GUI or other 
end-user interface, they are ultimately dealing with (asking 
questions of or sending commands to) the Intelligent Agent 
Coordinator. The Intelligent Agent Coordinator has four 
primary responsibilities: 1) monitoring user activities, 2) 
handling information requests, 3) maintaining each user's 
profile, and 4) routing information to and from users and to 
and from the other respective agents. 
Monitoring User Activities 

Anytime a user triggers a sensor the Intelligent Agent 
Coordinator receives an "environmental cue." These cues 
not only enable the Intelligent Agent Coordinator to gain an 
understanding where users' are for information delivery 
purposes, but also to learn the standard patterns (arrival 
time, departure time, etc.) of each persons' life. These 
patterns are constantly being updated and refined in an 
attempt to increase the system's intelligence when deliver- 
ing information. For instance, today it is not uncommon for 
a person to have several email accounts (work-based, home- 
based, mobile -based, etc.) as well as several different com- 
puters involved in the retrieval process for all of these 
accounts. Thus, for the Intelligent Agent Coordinator to be 
successful in delivering information to the correct location it 
must take into account all of these accounts and the times 
that the user is likely to be accessing them in order to 
maximize the probability that the user will see the informa- 
tion. This will be discussed further in another section. 
Handling Information Requests 

The Intelligent Agent Coordinator handles information 
requests from other agents in order to personalize informa- 
tion intended for each user and to more accurately reflect 
each user's interests in the information they are given. These 
requests will commonly be related to the user's profile. For 
instance, if an agent was preparing a traffic report for a user 
it may request the traffic region (search string) of that user 
from the Intelligent Agent Coordinator. All access to the 
user's profile data is accessed in this method. 
Maintaining User Profiles 

User profiles contain extensive information about the 
users. This information is a blend of user-specified data and 
information that the Intelligent Agent Coordinator has 
learned and extrapolated from each user's information and 
activities. In order to protect the data contained in the 
profiles, the Intelligent Agent Coordinator must handle all 
user information requests. The Intelligent Agent Coordinator 
is constantly modifying and updating these profiles by 
watching the user's activities and attempting to learn the 
patterns of their fives in order to assist in the more routine, 
mundane tasks. The Intelligent Agent Coordinator also 
employs other agents to glean meaning from each user's 
daily activities. These agents mine this data trying to dis- 
cover indications of current interests, long-term interests, as 
well as time delivery preferences for each type of informa- 
tion. Another important aspect of the Intelligent Agent 
Coordinator's observations is that it also tries to determine 
where each user is physically located throughout the day for 
routing purposes. 
Information Routing 

Most people are mobile throughout their day. The Intel- 
ligent Agent Coordinator tries to be sensitive to this fact by 
attempting to determine, both by observation (unsupervised 
learning) and from cues from the environment, where users 
are or are likely to be located. This is certainly important for 
determining where to send the user's information, but also 
for determining in which format to send the information. For 
instance, if a user were at her desk and using the web client, 
the Intelligent Agent Coordinator would be receiving indi- 
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cations of activity from her PC and would know to send any 
necessary information there. In addition, because desktop 
PCs are generally quite powerful, a full-featured, graphically 
intense version could be sent. However, consider an alter- 
native situation: the Intelligent Agent Coordinator has 
received an indication (via the keycard reader next to the 
exit) that you have just left the building. Minutes later the 
Intelligent Agent Coordinator also receives notification that 
you have received an urgent message. The Intelligent Agent 
Coordinator, knowing that you have left the building and 
having not received any other indications, assumes that you 
are reachable via your handheld device (for which it also 
knows the capabilities) and sends the text of the urgent 
message there, rather than a more graphically-oriented ver- 
sion. 

Inherent Innovations 

The Active Knowledge Management system represents 
some of the most advanced thinking in the world of knowl- 
edge management and human computer interaction. Some of 
the primary innovations include the following: 

The Intelligent Agent Coordinator as illustrated above. 
The development, demonstration, and realization of the 

theory of Intelligent Information Delivery 
Support for several channels of information delivery, all 
of which utilize a common back-end. For instance, if a 
user is in front of a Magic Wall the information will be 
presented in a multimedia-rich form. If the system 
determines that the user is mobile, the information will 
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be sent by to their Awareness Machine in standard text. 
It facilitates delivery of information whenever and 
wherever a user requires the information. 

Personalization of information based not only on a static 
user profile, but also by taking into account history of 
the user interactions and current real-time situation 
including "who, where, and when" awareness. 

Utilization of fast and scalable Information Prioritization 
Subsystem that takes into account Intelligent Agents 
Coordinator opinion, user preferences, and history of 
user interactions. It takes the load of mundane deci- 
sions off the Intelligent Agents part therefore allowing 
the agents to be much more sophisticated and precise 
without compromising the system scalability. 

Speech recognition and speech synthesis in combination 
with intelligent agent animated representation and tac- 
tile input provides for efficient, intuitive, and emotion- 
ally rewarding interaction with the system. 

Supporting Code in Accordance With A Preferred 
Embodiment 

The following code is written and executed in the 
Microsoft Active Server Pages environment in accordance 
with a preferred embodiment. It consists primarily of 
Microsoft Jscript with some database calls embedded in the 
code to query and store information in the database. 



Intention-Centric Interface 
Create an Intention ASP Page ("intention_create.asp") 



<%@ LANGUAGE = "JScript" %> 
<% 

Response.Buffer = true; 
Response.Expires =» 0; 
%> 

<html> 
<hcad> 

<title>Crcate An Intention </title> 
</head> 

<body bgcolor="#FFE9D5" style="f out-family: AriaL" text="#O00000": 
<% 

//Define some variables 

upl = Server. CreateObjectC 4 So ftArtisans.FileUp") 
intention__name = upl. Form (*'intention_name") 
intention__desc = upl.Form("intention_desc") 
//intention_name - Request.Fonn("intention_name") 

//intention desc = Request.Form("intention desc") 

//intention icon = Request.Form("intention icon") 

submitted = upl .Form("submitted") 
items = new Enumerator(upl.Form) 



//Establish connection to the database 

objConnection » Servei.CreateObject("ADODB.Connection") 

objConnection. Open ("Maelstrom") 

%> 

<% 

//Check to see if the person hit the button and do the appropriate thing 
if (submitted - - "Add/Delete") 

{ . 

flag = "false" 

//loop through all the inputs 

while(!items.atEndO) 

{ 

i - items, item 0 

//if items are checked then delete them 

if (upl. Form (i) «= "on") 

{ 

objConnection.Executef "delete from user_intention where 



11/20/2002, EAST Version: 1.03.0002 



US 6,317,718 Bl 
41 42 

-continued 



Intention- Centric Interface 
Create an Intention ASP Page ("intention w _create.asp") 

intention id =" + i); 

objConnection.Execute("delete from intentions where 
intention id =" + i); 

objConnection.Execute(" delete from tools_to_intention where 
intention_id «" + i) 

flag = true" 

} 

items, mo veNextO 

} 

// if items were not deleted then insert whatever is in the text field in the 
database 

if(flag = - "false") 
{ 

mtention_name_short = intention__name.replace(/ /gi, " ") 

objConnection.Execute("INSERT INTO intentions 

(intention name^ntention desc>intention icon) values(*" + intention_name + *", "'- + 

intention desc + '" + intention name_shoit + ".gif' + "')") 

Response, write ("the intention short name is " 30 intention name_short); 

upl.SaveAs("E:development/asp_examples/"+ intention name short 

+".giP») 
} 

} 

// Query the database to show the most recent items. 

reCustomersList - objConnection.Execute("SELECT * FROM intentions") 

%> 

<input type-"Submit" name-"retum_to mcp" value-"Go to Main Control Panel" 

onclick-"location.href-*default.asp" > > 

<form method-"post" action-" intcntion_crcatc.asp" enctvpc»"multipart/fonn-data" > 
<TABLE border=0> 

<trxtd colspan="2"><£ont face="Ariar* size="+l"><b>Enter in a new 
intention </bx/font> </td></tr> 

<tixtdxfont face="Ariar , >Name:</fontx/td> <td><INPUT TYPE="text" 
name=" intention_namc"> </tdx/tr > 

<trxtdxfont facc="Arial">Dcscription:</fontx/tdxtd>^TEXTAREA 
na me=intentio n_dcsc"> <^TEXTAREAx/td> </tr> 

<trxtdxfont face="Arial">Icon Image :</fontx/td><tdxINFUT TYPE="file" 

NAME="intention_icon" size=40x/tdx/tr> 

<trxtd colspan="2"xINPUT type="submit" name="submitted" 

va lue=" Add7Delete"x/td></tr > 

</TABLE> 

<HR> 

<font face="Aiiar' si2e»"+l"xb>Current Intentions </b></foat> 
<TABLE> 

<tr bgcolor«E69780 align= 'center"> 

<td> 

<FONT coloi="white">Delete</FONT> 

</td> 
<TD> 

<FONT color="white">Itention</FONT> 

<yTD> 

<TD> 

<FONT color=" white" >Description<yFONT> 
</TD> 
<TD> 

<FONT color-"white">Image«^ONT> 
</TD> 
</ti> 

<% 

II Loop over the intentions in the list 
counter - 0; 

while (!rsCustomersList.EOF) 
%> 

<tr bgcolor»" white" style="font-size: smaller" > 
<td align«center> 

<INPUT type=*chcckbox" 
name="<%=rsCustomersList("intcntioiuJd")%>"> 
</TD> 
<td> 

<%» is Custo mersList(" intentio n_name") %> 

<Jtd> 
<td> 

<%= rsCustomersList("intention_desc")%> 
</ld> 
<td> 

<img src=*\./images/<%= rsCustomeisList("intention_icon")%>"> 
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-continued 



Intention- Centric Interface 
Create an Intention ASP Page ("intention__create.asp*') 

</tr> 

<% 

counter+ + 

rsCustomerslis t.Mo veNextQ} 
%> 

</TABLE> 
<hr> 

Available Tools 
</form> 
</BODY> 
</HTML> 



Retrieve Intentions List ASP Page ("intentions_list.asp") 



<!-- include flle="include/check_authentication.inc" --> 

<HTML> 

<HEAD> 

<TFTLE>mySite! Intentions List</TTTLE> 
<SCRIPT LANGU AGE-"JavaScr ip t' ' > 
function intentions list 0 { 

this.internalArray - new Array 0; 
<% 

/f establish connection to the database 

obj Connection = Server.CreateObject("ADODB. Connection"); 
obj Connection. Op cn(" Maelstrom ") ; 
// ejeate query 

intentionsQuery = obj Connection .Exccute(" SELECT * FROM intentions 
ORDER BY intcntion_name asc")i 
%> 

ti write out the options 

<% 

numOptions = 0 

while (lintentionsQuery.EOF) { 

intentionName = intentionsQuery ("in ten tion__name"); 

intentionlcon = intentionsQuery ("intention_icon"); 

%> 

this.internalArray[<%= numOptions%>] = new Array(2); 
this.internalArray[<%= numOptions %>I0] = "<%= intentionName 

%>"; 

this, internal Array [<%= numOptions%>Jl] = "images/<%= 
intentionlcon %>"; 

<% numOptions+ +; intentions Query, mo veNextO; %> 

<% } %> 
} 

numlntentions = <%= numOptions%>; 
intentionArray = new in tentionsUstQ.internal Array; 
function selectlntention 0 { ' 

for (i=0;i<numlntentions;i+ +) { 

if (IntentionsListSelect.options[i].selected) { 

intentionNameTextField. value - intentionArray[i][0]; 
//intentionPicture.src - intentionArray[iJl]; 
break; 

} 

} 

} 

</SCRIPT> 
</HEAD> 

<BODY BGCOLOR="<%=SessionC"main_background"(%>" styLc»"font-family: Arial"> 
<CENTER> 

<!— <FORM NAME~"intention__list"> ™> 

<TABLE FRAME="BOX" bordcr=0 CELLPADDING="2" CELLSPACH>TG= U 2"> 

<TRxTD COLSPAN="3" STYLE="font: 20pt arial" ALIGN="CENTER"><B>Add a mySite! 

Intention</B></TD></TR> 

<TR><TD COLSPAN="3 ,, > </TD></TR> 

<TR> 

<fTD width=" 100"><font size="-l">Please Select An Intention You Would Like to 
Add to Your Iist</font></TD> 

<TD colspan=2> 

<S ELECT ID="IntentionsListSelect"NAME="IntentionListSelect" 
SIZE-" 10" style="font: 9pt Arial;" onClick="selectIntentionO" > 
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Retrieve Intentions List ASP Page ("intentions_list.asp") 

<% 

intcntionsQucry.rao veFirstO ; 
fbr(j=0;j<numOptions;j+ +) { %> 

<OPTTON VALUE="<%= intentionsQuery("intention_id") %>" <% if 
G " 0) { %>SELECTED <% } %» 

<%" intentionsOuery("intention_narae") %> 

<% intentionsQuery. mo veNextQ 

} 

intentionsQuery.mo veFirstO; 
%> 

</SELECT> 
<JTD> 
</TR> 

<TRxTD COLSPAN="3"> </TD></TR> 
<TR> 

<TD width="100"xfont size="-l">Customize the Intention name</fontx/TD> 
<TD COLSPANr=2"xINPUT TYPE="text" NAME^'mtentiordVameTextField'' 

ID="intentionNameTextField" SIZE="30" VALUE="<%= intentionsOuery("intention name") 

%>"></TD> 

</TR> 

<TRxTD COLSPAN- M 3"> </TD></TR> 
<TR> 

<TD COLSPAN- "3" ALIGN- a CENTER"> 

<INPUT TYPE-"button" NAME-"intentionOKButton" VALUE-" OK 
SIZE-"10" ID-"intentionOKButton" 

onClick-"javaScript:top.openei.top.navframe.addAnIntentionQ;"> 

&nb sp ;&nbsp ;   & nbsp ; &nbsp ;&nbsp ;   &nb sp ;&nb sp ; &nbsp ; & nbsp ; & nbsp; & rib sp 
;  

<INPUT TYPE="button" NAME="intentionCancelButton" VALUE="Cancel" 
SIZEV'10" ID="intentionCancelButton" onClick^self.closeO;^ 

</TD> 
</TR> 
VTABLE> 
<!--- ^/FORM> — > 
</CENTER> 

<% objConnection.CloseO; %> 

</BODY> 

</HTML> 



Display User Intention List ASP Page (excerpted from "navigation. asp") 

<DIV [D»"intentionList" style="position: absolute; width: 210; height:95; left: 365pt; 
top: -5; visibility: hidden; font-family: Arial; font-color: #000000; font: 8pt 
Arial ; " > 

<DIV style="position: absolute; top:7; left:7; height:78; width:210; z-index:2; 
background: <%=Session("main_background"(%>; border: solid Ipt #000000; padding: 3pt; 
overflow: auto; alink: black; link: black;"> 
<body LINK="#000000" ALINK«"000000" vlink="black"> 
<% 

If create query 

intentionsQuery - obj Connect ion. Execute("S ELECT 
user^mtention.* FROM user__intention, user__intention_to_persona WHERE 
user_intention_to_pereona.user__per6ona_id - " + Session("currentUserPersona") + " AND 
usei_intention_to_persona.user_intention_id - user_intention.user_intention_id" ); 

numintentions - 0 

Response. Write("<SCRIPTVaujnintentions-" + 
intentionsQuery.RecordCount + "-^/SCRIPTxTABLE cellpadding-'O' width-' 100%' 
cellspacing- '0 '>"); 

while (lintentionsQucry.EOF) 

{ 

%> 

<TRxTDxa hre£="javascript:changeIntention(' <%= 

intentionsQuery ("user_intentioo id") %>',' <%=numintentions%>')" 

onmouscover«"mouseOverTabO'* onmouscout»"mouscOutOfTab()"><foiit color= "Black" 
facc="arial" sizc»"-2"x%= intentionsQuery("iritcntioD_custom_naine") 
%></font></ax/TT>xTDxIMG align="right" SRC="images/deIete.gif" alt="Delete this 
intention" onClick="confirmDelete(<%= intentionsQuery(* i user_Jntention_Jd") 
%>)"></TDx/TR> 

<%numintentious+ +; intentionsQuery.moveNextO; %> 

<% } 

Resp onse. Write(" <SCRIPT>numintenlions="+numintentions 
+"</SCRIPT>"); 
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-continued 



Display User Intention List ASP Page (excerpted from "navigation. asp") 
%> 

<tT><td colspan="2"xhr></td></tr> 

<TR> <td colspan="2" > <a hicf="javascrip t : changeIntcntion( ' add 
. . . ',<%=numintentions%>);" onrnouseover="mouseOverTabO" 
onmouseout="mouseOutOfIabO"xfoQt color»" Black 1 ' face<="arial" size="-2">add 
. . . </forjt></a></td></TR> 

</table> 

</body> 
</DIV> 

<DIV style="position: absolute; top:0; left:-5; width: 230; height:105; z-index:l; 

" onmouseout="intentionlist.style.visibi]ity=* hidden'" 

onmouseout='*intentionlist.style.visibility=*hidden'" 

onmouseo ver="intentionlis Lstyle.visib ility= ' hidden' "> </DI V> 

</DIV> 

</DIV> 



A preferred embodiment of a system utilizes a Windows 
CE PDA equipped with a GPS receiver. The embodiment is 
configured for a mall containing a plurality of stores. The 
system utilizes a GPS receiver to determine the user's 
location. One advantage of the system is that it enables the 
retrieval of data for nearby stores without relying on the 
presence of any special equipment at the mall itself. 
Although the accuracy of smaller, inexpensive receivers is 
limited to approximately 75-100 feet, this has thus far 
proven to be all that is necessary to identify accurately the 
immediately surrounding stores. The system uses generated 
data rather than actual store ads and prices. Well structured 
online catalogs are used. Other embodiments utilize agents 
that "leara to shop" at a given store using a relatively small 
amount of knowledge. Moreover, as retailers begin to use 
standard packages to create online catalogs, we can expect 
the number of differing formats to decrease, resulting in a 
tractable number of competing formats. As electronic com- 
merce progresses, it is not unreasonable to expect standards 
to evolve governing how merchandise offerings are repre- 
sented. 

Goal Specification 

Before leaving on a shopping trip, a shopper creates a 
shopping list of items by selecting from a preexisting set of 
approximately 85 product categories (e.g. men's casual 
pants, women's formal shoes, flowers, etc,). They also 
indicate the shopping venue they intend to visit from a list 
of malls. 

Initial Store Selection 

Upon arriving at the mall, begins by suggesting the closest 
store that sells at least one item of a type entered by the user 
during goal specification. Along with the store name a 
system in accordance with a preferred embodiment prepares 
a list of the specific items available and their prices. A map 
of the mall displays both the precise location of the store and 
the shopper's current location. The shopper queries the 
system to suggest a store at any time based on their current 
location. 
Browsing 

To address the need of many shoppers to visit malls or 
shop generally without a particular destination in mind. FIG. 
27 illustrates a display in accordance with a preferred 
embodiment of the invention. The display operates in a 
browse mode for use by shoppers as they stroll through the 
mall. In browse mode the system suggests items of interest 
for sale in the stores currently closest to the shopper. An item 
is considered to be of interest if it matches the categories 
entered in the goals screen. If there are no items of interest, 
the general type of merchandise sold at that store is 



2 q displayed, rather than specific items. As the shopper strolls 
a map displays his or her precise current location in the mall. 
If an item displayed is selected by the shopper while 
browsing, the system alerts the shopper to the local retailer 
offering the same product for the lowest price, or announces 

25 the best local price . This search is restricted to the local mall, 
as that is the assumed radius the shopper is willing to travel. 
Alternatives 

It is worth emphasizing that the current inventive agent 
will support broader aspects of the shopping task, for 

30 example, it could operate as bi-directional channels. That is, 
not only can they provide information to the shopper, but, at 
the shopper's discretion, they may provide information to 
retailers as well. In this embodiment, the system indicates a 
shopper's goals and preferences to a retailer-based agent, 

35 who, in turn, responds with a customized offer that bundles 
service along with the product. Enabling the customization 
of offers is crucial to gaining the cooperation of retailers who 
are reluctant to compete solely on price and of value to 
customers who base their purchases on criteria other than 

4Q price. While the preferred embodiment focuses on location- 
based filtering primarily in the context of the shopping task, 
the current invention provides the basis for "physical task 
support" agents that provide an information channel to 
people engaged in various tasks in the physical world. 

45 The Predictive Value of Location 

The present invention is a significant advance over non 
location based agents because a users physical location is 
often very predictive of his or hers current task. If we know 

50 someone is at a bowling alley or a post office we can 
reasonably infer their current activity. Knowledge of a user's 
current task largely determines the type of information they 
are likely to find useful. People are unlikely to concern 
themselves with postal rates while bowling, or optimal 

55 bowling ball weight while buying stamps. In addition, 
knowledge of the resources and obstacles present at a 
particular location suggest the range of possible and likely 
actions of someone at that location. This awareness of a 
user's possible and likely actions can be used to further 

60 constrain the type of information a user is likely to find 
useful. For example, knowledge of a restaurant's wine list 
could be used by a recommender system to constrain the 
wine advice it presents. 

Knowledge of a shopper's precise location in a shopping 

65 mall is valuable because it enables the identification of the 
stores immediately surrounding the shopper The offerings 
of the stores closest to the shopper represent the immediate 
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choices available to the shopper. Given that shoppers place 
a premium on examining merchandise first hand and that 
there is a cost associated with walking to other stores, the 
merchandise of the closest surrounding stores constitute the 
most likely immediate selections of the shopper. s 
Consequently, among the most useful information provided 
at any given time is the availability of merchandise in the 
surrounding stores that matches their previously stated 
goals. 

People tend to move to different locations while perform- ]0 
ing many of their our tasks. This suggests that their imme- 
diate surroundings do not completely capture the full range 
of options they may have. In fact one of the main reasons for 
leaving a location is to perform an action that is not possible 
at the current location. Nevertheless, one does tend to 
address most tasks within relatively local areas. Thus while 15 
their immediate surroundings suggest the options they have 
available at a given point in time, a broader view of a 
location will often capture the options they are likely to 
consider over the course of a task. In the case of mall 
shopping, for example, the stores immediately surrounding 20 
the shopper represent the options available at that moment. 
Mall shoppers, however, are generally willing to travel to 
any store within the mall. Therefore the potential options 
over the entire shopping trip include all the stores in the 
mall. Accordingly, information is presented on offerings of 25 
interest only from the immediately surrounding stores 
because these are the immediately available options. When 
asked for alternatives, the system restricts itself to all the 
stores within the mall — the area within which the shopping 
task as a whole is likely to be performed. Being alerted that 30 
a store hundreds or thousands of miles away sells the same 
merchandise for a few dollars less than the cheapest local 
alternative is of little value in cases when shoppers require 
a first hand examination of the merchandise in question or 
are not willing to wait for shipping. 35 

Physical Vs. Online Shopping 

In addition to the significant advantages over non-location 
based agents the present invention over comes disadvan- 
tages o online (or web) shopping. It is tempting to argue that 40 
online shopping will soon become the predominant mode of 
shopping, pending only greater penetration of home 
computers, the expansion of online offerings, and better 
online shopping tools. At first glance it would therefore 
appear to be a mistake to begin using location to support an 45 
activity that will become virtualized. Already we've seen the 
emergence of a number of software agents that support 
online shopping. For example, programs that allow users to 
identify the cheapest source for a music CD, given a title. 
Similar programs have been developed for buying books, 50 
such as BargainBot. These systems demonstrate the poten- 
tial of electronic commerce web agents to create perfect 
markets for certain products. The success of these agents 
will encourage the development of similar web shopping 
agents for a greater variety of goods. 55 
The Limitations of Online Shopping 

Certainly online shopping will continue to grow and the 
trend towards more powerful online shopping agents will 
continue. Nevertheless, it also seems clear that no matter 
how sophisticated web-agents become, traditional physical 60 
shopping will continue to dominate the market for the 
foreseeable future. Several inherent difficulties of online 
shopping will ensure the continued reliance on physical 
shopping: 

Non-fungible Goods 65 

Web-based shopping agents have typically enabled users 
to identify the cheapest price for fungible products such as 



books and music CDs. While this capacity to create "perfect 
markets" for such commodities is of great benefit to 
consumers, several difficulties exist that will complicate 
applying these approaches to arbitrary products. 

Commodities are particularly well suited to shopping 
agents because it is easy to make comparisons between 
competing offers. Because commodities are fungible, one of 
the very few dimensions upon which they differ is price. 
Price therefore becomes the primary, if not sole, criterion 
upon which purchasing decisions are made. 

As soon as we move beyond commodities, however, 
several other criteria become important. For example, how 
do we compare items such as sweaters, mattresses, or tables? 
In addition to price we care about the materials used, the 
color, how it fits and feels, and the workmanship. Similar 
problems apply to most other products. 
Imprecise Goal Specification 

A second, related difficulty lies in communicating our 
desires to an agent. Shopping agents are great if the user 
knows the precise commodity he or she wants. Then they 
can simply enter the product by name. Unfortunately, if they 
don't have a specific item in mind when they shop, then the 
problem of conveying what is wanted to an agent becomes 
more difficult. For example, how does the user tell an agent 
what kind of lamp they want for their living room? 
Undeveloped Preferences 

Interfaces that allow shoppers to include descriptive fea- 
tures like price ranges, color, options, brands, etc, can help 
address the above problem, but they are not enough. Much 
of the time shoppers either haven't formed preferences or 
can't articulate their desires until after they've started shop- 
ping and had a chance to examine various examples of the 
target products. 
Shopping is Entertainment 

People like to shop and do so without having a specific 
purchase in mind. One study found that 42% of consumers 
are "non-destination shoppers" that visit the mall primarily 
for leisure browsing and socializing. 
Shopping is Sensory 

Even if the user could effectively provide these details 
most would be unlikely to delegate a purchasing decision to 
such an agent. After all, many people are uncomfortable 
even trusting spouses to make appropriate purchases on their 
behalf. Most people want to see and touch first hand what 
they're considering before making a purchase decision. The 
few preferences they may provide an agent cannot replace 
this rich, first-hand experience. At best such preferences 
could be used to generate a candidate set for shoppers to 
consider. 

Instant Gratification 

Shopping is often a very emotional activity. People are 
pleased with their purchases and often can't wait to get home 
to try them out. The inherent delay between online purchases 
and their receipt is a significant issue to those who simply 
must take home their selections as soon as they see them. 

In the end, consumers will continue to engage in physical 
shopping because of the limitations listed above. However, 
the fact that the task can't completely be delegated to 
software agents does not rule out a role for them. First, users 
find them useful for purchasing commodities when they 
know what they want. A second role, however, is to support 
the physical shopping task itself, throughout the time that a 
person is engaged in it. This, of course, is the approach taken 
in the SHOPPER'S EYE project. 
Shopper's Eye 

At first blush it may seem that the current invention is 
subject to some of the same limitations as purely web-based 



11/20/2002, EAST Version: 1.03.0002 



US 6,317 : 

51 

agents. After all, why should it be any easier to communicate 
your goals to a PDA than it is to a web-based agent? Why 
would your preferences be any more developed for pur- 
chases supported by a PDA system than a web -based agent? 

A key difference between purely web-based agents and 5 
the current "physical task support agents" (i.e. an agent that 
supports a user engaged in a task in a physical setting) is that 
web-based agents are completely responsible for conveying 
all information that will be considered by the user. On the 
other hand, "physical task support" agents in accordance 10 
with a preferred embodiment can augment the approaches of 
web-based agents by referring to aspects of a user's envi- 
ronment. For example, it is not terribly important to convey 
richly the feeling of a particular sweater if the sweater is in 
a store thirty feet away. It need only refer the shopper to the 15 
sweater. The shopper will gain a much better appreciation of 
the sweater by trying it on than through anything that can be 
conveyed by the system. When too many products match an 
imprecisely specified goal for a web-based agent, a more 
restrictive search must be made. However, many matches 20 
simply indicates there is a store that is likely to be of great 
interest to the shopper and therefore should be visited. Once 
inside, narrowing down the merchandise of interest in per- 
son will often be far easier than refining the goals on a 
web-based agent. Therefore physical task support agents can 25 
assist users to elaborate their preferences and identify spe- 
cific goals by calling users* attention to aspects of their 
physical environment as a means of conveying information 
throughout the entire course of the task. 
The Promise of Physical Shopping Agents 30 

It is hardly surprising that physical shopping has been 
neglected by the agents community. After all, until very 
recently there simply was no reliable way to deliver cus- 
tomized information to individual shoppers in remote loca- 
tions. However, the explosive growth of PDAs, and their 35 
increasingly sophisticated communications capabilities 
promise to make them effective channels of "just in time" 
information to users wherever they happen to be. The 
present invention provides an intuitive, novel agent that 
supports physical shopping by exploiting the promise of this 40 
developing channel that support all phases of the shopping 
task and solves the foregoing problems including: 
Specification of Goals 

Shoppers begin by indicating at least the general category 
of merchandise they are interested in. Shopping agents need 45 
to enable the specification of goals at various degrees of 
specificity. With the present invention these goals may be 
refined as the task progresses. 
Exploration of Product Space 

Before shoppers can make a selection, they need to 50 
become educated about what is available. Shopping agents 
can aid in this task by presenting various classes of offerings, 
reviews, demonstrations, etc. The present inventive Physical 
shopping agent can augment this by providing shoppers with 
a tour of the locally available offerings. 55 
Refinement of Preferences 

A shoppers learn what is available and examine the 
offerings their preferences evolve. Agents need to enable 
shoppers to refine their preferences over time. The present 
invention allows the user to refine their preferences. 60 
Identification and Comparison of Candidate Products 

As shoppers begin to understand what they want and what 
is available they typically compile a list of candidates that 
will be considered more carefully. The present inventive 
agents supports the construction and maintenance of such 65 
lists and facilitates the comparison of candidates within the 
list according to various criteria. 
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Negotiation of Offers 

The present shopping agent is not restricted to providing 
the shopper with information. It is possible to negotiate 
prices and service options with retailers. 
Product Selection, Purchase and Product Support 

The present invention facilitates the transaction itself and 
can be used as a channel through which product service can 
be delivered. 

While various embodiments have been described above, 
it should be understood that they have been presented by 
way of example only, and not limitation. Thus, the breadth 
and scope of a preferred embodiment should not be limited 
by any of the above described exemplary embodiments, but 
should be defined only in accordance with the following 
claims and their equivalents. 

What is claimed is: 

1. A method for creating a customized offer information 
summary, comprising the steps of: 

(a) obtaining one or more items of interest of a user; 

(b) determining a physical location of the user; 

(c) creating a query based on the items of interest and the 
physical location of the user; 

(d) querying a communication network of information 
utilizing the query; 

(e) receiving a customized offer from a retailer-based 
agent in response to the query; 

(f) displaying the customized offer information associated 
with the items of interest and their locations relative to 
the physical location of the user; and 

(g) alerting the user to a best local price. 

2. A method for creating a customized offer information 
summary as recited in claim 1, including the step of parsing 
the terms based on predefined criteria to create the query. 

3. A method for creating a customized offer information 
summary as recited in claim 1, including the step of pro- 
viding constants that are utilized by the system for dynami- 
cally configuring the system based on current user inputs. 

4. A method for creating a customized offer information 
summary as recited in claim 1, including the step of dis- 
playing a list of items available at a store and the prices 
associated therewith. 

5. A method for creating a customized offer information 
summary as recited in claim 1, including the step of sug- 
gesting items of interest for sale in stores currently closest to 
the user. 

6. A method for creating a customized offer information 
summary as recited in claim 1, including the step of pattern 
recognition to enhance the location of pertinent information. 

7. A method for creating a customized offer information 
summary as recited in claim 1, including support for que- 
rying the Internet to obtain pertinent information. 

8. A method for creating a customized offer information 
summary as recited in claim 1, including optimizing the 
query for a particular search engine. 

9. An apparatus that creates a customized offer informa- 
tion summary, comprising: 

(a) a processor; 

(b) a memory that stores information under the control of 
the processor; 

(f) logic that obtains one or more items of interest of a 
user; 

(g) logic that determines a physical location of the user; 

(h) logic that creates a query based on the items of interest 
and the physical location of the user; 

(i) logic that queries a network of information utilizing the 
query; 
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(j) logic that receives a customized offer from a retailer- fies constants that are utilized by the system for dynamically 

based agent in response to the query; configuring the system based on current user inputs. 

(k) logic that displays the customized offer information 13 A computer program embodied on a computer- 
associated with the items of interest and their locations readable medmm ^ at «f ^ a customized offer information 
relative to the physical location of the user; and 5 summary as recited m claim 10, including logic that displays 
r J a list of items available at a store and the prices associated 

(1) logic that alerts the user to a best local price. therewith. 

10. A computer program embodied on a computer- 14 ^ computer program embodied on a computer- 
readable medium that creates a customized offer information readable medium that creates a customized offer information 
summary, comprising: ^ summary as recited in claim 10, including logic that suggests 

(a) a code segment that obtains one or more items of items of interest for sale in stores currently closest to the 
interest of a user; user. 

(b) a code segment that determines a physical location of 15 A computer program embodied on a computer- 
the user; readable medium that creates a customized offer information 

(c) a code segment that creates a query based on the items 15 summar y as recited L in claim 1°' includi ?g lo ? c that recog- 
of interest and the physical location of the user; Jjj^ P attems t0 enhance ,he locatlon of P er,lnent informa - 

(d) a code segment that queries a network of information U °J 6 A progtam embodied on a ^p^. 
utilizing me query, readable medium that creates a customized offer information 

(e) a code segment that receives a customized offer from summary as recited in claim 10, including logic that queries 
a retailer-based agent in response to the query; and me Internet to obtain pertinent information. 

(f) code segment that displays the customized offer infor- 17. A computer program embodied on a compute r- 
mation associated with the items of interest and their readable medium that creates a customized offer information 
locations relative to the physical location of the user. summary as recited in claim 10, including logic that opti- 

11. A computer program embodied on a computer- 25 mizes the query for a particular search engine, 
readable medium that creates a customized offer information 18. A method for creating a customized offer information 
summary as recited in claim 10, including logic that parses summary as recited in claim 1, wherein the communication 
the terms based on predefined criteria to create the query. network of information includes a network of retail-based 

12. A computer program embodied on a computer- agents, 
readable medium that creates a customized offer information 

summary as recited in claim 10, including logic that modi- ***** 
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